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ABSTRACT 


Knowledge of the relationship between synoptic surface 
weather-map patterns and various weather parameters is fundamental 
to the production of an aviation forecast. A sound training in 
atmospheric dynamics, combined with actual forecast experience, 
enables a forecaster to obtain an understanding of this complex 
relationship. Statistical information, based on historical data, 
would be a useful aid to the aviation forecaster in that it would 
objectively expand his knowledge gained through experience. This 
thesis examines the relationships between objectively determined 
surface map types and associated weather. Percent probabilities of 
occurrence of aviation weather parameters associated with the map types 
are calculated,and those for ceiling and visibility categories are 
used as a simple conditional-probability forecast model. The map- 
type forecasts are tested against pure climatological forecasts 
using an independent data sample. 

A catalogue of surface map types occurring over the 
Mackenzie River Valley during the three coldest winter months is 
developed from 27 years (1946-1972) of MSL grid-point pressure data. 
The computerized correlation methods developed by the United States 
Air Force (USAF) at Coiorado Springs were used to produce the cata- 
logue. The catalogue comprises a summary of the occurrence and 
pressure characteristics of map types in addition to a chronological 


listing of the types assigned to each of the 3814 maps in the data 
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base. Interesting relationships between map types in the catalogue 
and climatic anomalies at Yellowknife are presented. 

Twenty years (1953-1972) of hourly weather data for Yellow- 
knife are used to examine the relationships between map types and 
aviation weather parameters. Percent probabilities of occurrence of 
ceiling and visibility categories, precipitation, wind speed and wind 
direction, associated with map types, are calculated from the first 
16 years of hourly data. The conditional probabilities of ceilings 
and visibilities are used to forecast these same parameter occurrences 
during the four years 1969-1972. Map-type forecasts were generally 
better than pure climatological forecasts over this period. Poor 
forecast reliability, caused by over-stratification of the data, 
emerged as a major problem when the map types were stratified by 
pressure gradient. Methods to improve reliability and some suggestions 


are presented. 
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CHAPTER | 


INTRODUCTION 


1.1 Statistical Weather Prediction by. Correlation Methods 


With continued advances of computer technology into the field 
of meteorology there has been increasing interest in the development 
of statistical weather prediction techniques. Two of the more common 
approaches to the development of probabilistic forecast aids are 
through the development of regression equations and through the associa- 
tion of weather with map patterns. A desirable feature of the map 
pattern approach is that it conforms to the traditional forecasting 
practice of relating weather parameters to synoptic map patterns. 

Until recently this approach has been hampered by the subjectivity 
required in the identification of similar map patterns or types. 

The objective correlation technique, developed by Lund (1963) 
and later modified by the USAF, has been used in several studies to 
classify and identify weather map types. It entails calculating the 
simple linear correlation coefficient between the values of a specific 
meteorological quantity on a weather map and those values at the 
same location on other weather maps. Maps that are highly correlated 


with each other are grouped into designated types. Those maps that 
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do not correlate highly with any of the maps are assigned to an 
uncorrelated group. This group may also contain some maps that cor- 
relate highly with only a few maps which, when taken as a group, are 
not numerous enough to constitute a type. 

Once the maps have been grouped into types, climatic data 
from within the map-type region are used to study the relationships 
between weather phenomena and the map types. Most of these correla- 
tion studies have involved the relationship between precipitation 
and map types (Augulius, 1969 and 1970; Hartranft et al., 1970b; 


Paegle and Kierluf, 1974; Kociuba, 1974; Paegle and Wright, 1975). 


1.2 USAF Applications of Map-Type Climatology to the Prediction of 


Visibilities and Ceilings 


The incorporation of objective map-type classification 
and identification techniques into the of Periey prediction of 
ceilings and visibilities was proposed in the United States Air 
Force (USAF) publication on map typing by Hartranft et al. (1970a) 
in Colorado Springs. They suggested the development of seasonal, 
surface map-type catalogues for six designated areas or ''windows'' 
across the continental United States (CONUS). It was believed that 
stratifying conditional climatology tables (CC) according to the 
catalogued map types would improve this type of objective forecast 
aid by incorporating the causitive synoptic situation into these 
purely climatological tables. 

CC tables give the climatological probabilities of the 


ceiling and visibility categories occurring at selected time 
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intervals after an initial time when the initial categories are 
given. The standard tables are usually stratified by season and 
time of day. Restivo (1966) elaborates on the development of these 
tables which are also referred to as persistence probability tables. 
CC tables were produced for several of the winter map types in the 
Great Lakes window using November hourly weather data from Duluth, 
Minnesota. Results based on the dependent data sample showed that 
map-type-stratified, conditional climatology (MTCC) tables offered 

a significant improvement over the standard CC tables. 

After two years of continued research of map-typing con- 
cepts, refinement and documentation of development techniques at 
Colorado Springs (Sabin, 19/2; Sabin’ and Nieman, 1972: Scholefield, 
1972 and 1973a; Wold, 1973; Sabin, 1974) a map-type forecast system 
was officially proclaimed by the USAF Air Weather Service in June of 
1972 (Scholefield, 1973b). A Map-Typing Project Office was estab- 
lished at Colorado Springs which produced map-type catalogues for 
fourteen CONUS windows, two in Europe and one for Japan. MTCC tables 
were produced from these catalogues for several USAF forecast offices. 
It had been planned to incorporate MTCC into the USAF Global Weather 
Center's automated terminal forecast model as a climatological check 
in the forecast procedure. CC tables stratified by wind direction 


(WSCC) were currently being used for this purpose. 


1,3) VeFITication Results 


In 1974, at Colorado Springs, a verification procedure was 


carried out using two years of independent data to compare the 
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performance of CC, MTCC and WSCC models in the forecasting of ceiling 
and visibility categories. Tables were developed from thirteen to 
sixteen years of dependent data. Contingency tables were constructed 
for the three forecast models and for a persistence model. Skill 
scores were calculated for each model against chance and persistence. 
The overall results showed little difference between the four models. 
The results of this verification have not yet been published, but 
they indicate that stratification of the standard CC tables by map 
types or wind direction do not significantly improve the forecasting 
ability of the standard tables. This conclusion is contrary to what 
had been previously indicated by tests involving only dependent data. 
Air Weather Service is currently concentrating its stat- 
istical prediction efforts on the model output statistics (MOS) 
approach to the objective forecasting of ceilings and visibilities 
(Bocchiere et al., 1972 and 1974). Results of the rigorous verifica- 
tion of the MOS models for forecasting ceilings and visibilities 
have been encouraging. Forecasts from MOS models have been shown 
to be an improvement over climatology and persistence forecasts. They 
even verified better than official subjective forecasts beyond the 
short range period. There are some disadvantages to the MOS approach, 
including the short period of data available for model development 
and the fact that the models become obsolete with the Roeder on 
of new or improved numerical weather prediction models. 
One advantage that the map-type approach has over regression 
models such as MOS is that the verification results can be stratified 
by the relevant synoptic weather situation. The map-type forecast 


can then be shown to give relatively better or worse results under 
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different synoptic situations. The Colorado Springs verification 

did not consider this aspect nor was there any attempt made to improve 
the verification results by further stratification of ceiling and 
visibility data. Further research and a more detailed verification 

is required to assess the usefulness of map-type climatology in the 
development of automated forecast aids. 

The Map-Typing Project Office in Colorado Springs is current- 
ly in the process of dissolution because of the disappointing verifica- 
tion results and the current USAF involvement with MOS techniques. 

The possibility exists that the map-type catalogues will not be used 
for their intended purpose of providing a regional synoptic history 
of surface pressure patterns which, when related to aviation weather 


parameters, could be a useful aid to the aviation forecaster. 


1.4 Purpose 


lt is the intent of this thesis to apply the basic map-type 
techniques developed in Colorado Springs to the development of a 
surface map-type catalogue for the Mackenzie River Valley for the 
three coldest winter months. Included in the catalogue are statistics 
on the frequency of occurrence of map types, sequences of types and 
a listing of the map types occurring on each day of the 27-year 
period. 

Yellowknife hourly weather observations at map time and 
at three hours before and after map time are examined to show the 
relationship between significant weather parameters and the map types 


near the time of their occurrence. Percent probabilities of occurrence 
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of the parameters are determined for sixteen years of dependent 
data. These probabilities are used to predict the occurrence of 
ceiling and visibility categories and the results are verified using 
four years of independent data. 

Hourly observations at three-hour intervals from six hours 
before a map-type occurrence to twenty-four hours after its occurrence 
are used in the verification procedure. In addition to comparing 
verification results at different hours, a comparison is made between 
verification results for 00Z, 12Z and combined 00Z and 12Z maps. The 
final step in the verification procedure is an analysis of the re- 
sults of forecasts based on map types that have been stratified 
according to pressure gradients. The purpose of these comparisons 
is to determine the best way to proceed in the development of an 
automated objective forecast aid. The improvement of map-type fore- 
casts over pure climatological forecasts is carefully documented in 


order to assess the usefulness of this objective forecast technique. 
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CHAPTER 11 


THE BASIC DATA 


2.1 Geographical Area 


The difficulty in accurately forecasting weather for 
aviation terminals in the Mackenzie River Valley was appreciated 
during a forecasting assignment at the Arctic Weather Centre (AWC) 
in the summer of 1974. The sparseness of observational data and 
the formidable mountain ranges west of the valley are factors 
which challenge a forecaster's ability. A well-tested and readily 
accessible climatological synoptic forecast aid could be of con- 
siderable benefit to the forecasters at the AWC. 

The area or window used in the map-typing procedure is 
shown on Figure 2 which is located in Appendix 1. The window includes 
tine, 92.0 grid points which are numbered in the figure. Its size 
conforms with the criteria used by the Map-Typing Project Office to 
delineate the fourteen CONUS windows (Nieman and Sabin, 1972). It 
is large enough to enclose typical synoptic systems but not so 
large that small synoptic features might be ignored in the correlation 


of the overall pressure pattern. Printed on Figure 2 are the location 


'y 7 
ie 
i FA i? : 
as 
y ) Nite; 
eA (ye 
> aT) i 7 
7 7 
5 * i 
2 
5 eS sl 
-_ i . ‘ 
= 
¥- A 
» - » 
' 
‘ : 
it bd 
- rA 7} 
¥ ; 
~ 
' ~ 
La) 
. 
- 7 
‘J 
‘ 
E ft d m2 ‘ 
t rng / 
( j 
= ai 
] Soir 1a 
= vi af 
. * 
be F * (ae S ' 
Pi ‘ Y i ‘b, © , y = 
’ = 
; Pt ’ uf : ? ia] bao 7 as ,:¢ere 
‘ a ; —- L@ ) ii ie 
Poe | 2 Tu 5 79 rery | " rik s] i wis se"et Sey 


eitolant momiiw aT 6. whi oy a a 
hee 


= es Rei 


if 
} we 7 


guia” ef a) ib 9 ; Rah Rar ea if? - ' . Sm bog el 3g ; a2 as 


! 


- bert inva <ipW 5 At Ve es ‘efish) +a itt ees 


ioe 

‘ 2 a8 bun tk 7 aM Fe its > San Re i 
be tee i re yan ay Lo a 4 7 Tey 3 oases aoe 
‘ee nace ae cee! ri ae neigh ae 


* iz 3k Li a: yt 


oe 


# (aes : 
aang shih ho 


a: 


identifiers of those terminals for which 12-hour Terminal forecasts 
(FT's) are routinely prepared by the Atmospheric Environment Service 
(AES). Yellowknife (YZF) has the most extensive and complete set of 
hourly weather records in the Northwest Territories and for this 


reason was chosen as the principal site to be used in this study. 


27> Surface Data 


A 26-year data base (1946-1971) of mean sea level (MSL) 
pressures located at grid points on a standard 381 km grid was 
acquired from the Map-Typing Project Office in Colorado Springs. 
The data, arranged by month, are stored on two magnetic tapes. 
Pressures are available for 306 grid points on an 18 x 17 grid net- 
work which encompasses all of Canada, including the Arctic Islands 
and the Beaufort Sea. December, January and February pressure 
values at the twenty Mackenzie-window grid points were extracted 
from the two master tapes and stored on one smaller tape. MSL 12Z 
pressures are available for every year and 00Z values are available 
for the years 1956-1960 and 1963-1971. There is an exception in 
the case of December which has 00Z pressure values for the years 
1955-1959 and 1962-1971. Consideration was given to incorporating 
upper-level patterns into the scheme by developing a catalogue of 
500-1000 mb thickness patterns. Unfortunately, a comparable set 
of 500 mb height data was not readily available. 

Twenty years (1953-1972) of continuous hourly weather 
observations for Yellowknife were obtained from the AES. The data 


are chronologically ordered and stored on magnetic tape in the 
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standard AES card 1 type format. Data for November 30, all of 
December, January, February and March | were extracted from this 
tape and stored on a separate tape. 

To maximize the use of the twenty years of observations, 
1972 grid-point pressure values for the three coldest months were 
extracted by hand from 00Z and 12Z surface analyses stored at the 
AWC. These maps were also used to acquire pressure data for missing 
and incorrect data in the 26-year data base. A date check of the 
pressure data base had uncovered several errors and duplications 


which had to be corrected. 


2.3 Aviation Weather Parameters 


The selection of ceiling and visibility categories was 
based on a discussion with the Officer-in-Charge of the AWC, and 
on the classification that is used in hourly data summaries (Climat- 


ology Division, 1958). The categories are defined in Table 1. 


Table || 


Significant categories of ceilings and visibilities 


Category Ceiling (feet) Visibility (miles) 
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Categories A and B are below, and C and D are above the 
standard Visual Flight Rules (VFR) limits of 1000-foot ceiling and 
three-mile visibility. The 5000-foot ceiling and six-mile visibility 
limits are used in the international TAFOR code to delineate con- 
ditions significant to aviation. The occurrence of any amount of 
precipitation in excess of a ''trace'' is considered significant. Ice 
crystals, blowing and drifting snow are not considered as precipitation 
in this context. Expected windspeeds less than or equal to 12 miles 
per hour need not be forecast on an FT, but winds greater than 12 miles 
per hour are considered significant. 

Wind sditection, is not: Usual ly a chiti¢aleaviation forecast 
parameter and is not as difficult to forecast as are the other para- 
meters already mencionede Wind direction is, however, very dependent 
on the pressure configuration. It was therefore decided to use five 
simple direction categories to verify the anticipated good relation- 
ship between wind direction and the map types. The categories are 
defined as follows: 

N - north northwest to northeast 

—E - east northeast to southeast 

S$ - south southeast to southwest 

W - west southwest to northwest 

O8-scaln 

It has been previously mentioned that the hourly data were 
stratified according to pressure gradient. Increased stratification 
is desirable in order to define more accurately the conditions 


associated with the significant weather parameters. Too much strat- 
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ification will reduce the number of cases available for calculating 
the probabilities of occurrence to such an extent that the resulting 
statistics would not be reliable. Having only four categories of 
ceiling and visibility, instead of five or six, will help alleviate 
this problem. The available data are further maximized by consider- 


ing a three-month cold season instead of individual months. 


2.5 The Cold: Season 


Winter its the longest season of the year in the Mackenzie 
Valley and the winter months have greater percentages of poor aviation 
weather than summer months. Ten years (1957-1966) of Yellowknife 
hourly data summaries (Climatology Division, 1968) of temperature, 
precipitation, visibility and ceiling categories were examined. It 
was determined that a relatively uniform cold season exists for the 
three months of December, January and February. 

Figure | shows the monthly frequency of occurrence of 
weather below VFR conditions. The predominance of ''bad'' weather 
during the winter is the principal reason why a three-month cold 
season is used in the study. The reduced number of bad-weather cases 
during the warmer months could create statistical reliability problems 
for highly stratified data. 

The figure does show significant differences in the monthly 
frequencies of bad weather in the winter. The frequencies are greater 
than 20 percent in the earlier part of the winter and drop to less 
than six percent in late winter. Much of this bad weather in October 


and November is probably due to the influence of Great Slave Lake 
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Figure 1. Average percent frequency of weather below VFR 
(ceiling 0-900 feet and/or visibility 0-24 miles) 
based on ten years (1957-1966) of hourly observa- 
tions at Yellowknife. | 


which does not freeze over until December (Allen and Cudbird, 1971). 


The three coldest months are therefore desirable for this study 
because relationships between map types and bad weather during this 


cold period are not so likely to be complicated by lake effects. 


CHAPTER I11 


PHERSUREACE MAR SRYRES 


3.1 Developing the Basic Types 


The surface map types for the Mackenzie window were developed 
using the techniques of the Map-Typing Project Office in Colorado 
Springs. In particular, the batch technique of Sabin and Nieman 
(1972) and the computer programs of Wold (1973) were used to derive 
the Mackenzie catalogue. These methods, used extensively in the 
generation of the CONUS and Alberta map-type catalogues, are described 
tinedetall by Kociuba™ (1974) in’ Chapter "Fil of “his MrSes thesis’. 

One month's surface pressure data for the twenty grid points 
in the Mackenzie window were used to correlate all 12Z maps from 
1954-1971 with each other. The formula for the product-moment 


linear correlation coefficient (r) for n pairs of values is: 


The map that correlated with the largest number of maps in the 18- 
year sample at or above r = 0.8 was chosen as the key map for the 
First map type. That map and all others correlated with it were then 
removed from the sample. Of the remaining maps, the map which had 

the largest number of maps correlating with it became the key map for 
the second map type. This procedure of selection and removal was 
repeated until the number of maps assigned to a type became less than 
six. All the maps in the monthly sample were then reassigned to those 
particular types with which they correlated most highly at or above 
the threshold value of r = 0.8. Any map type having fewer than two 
percent of the total maps was eliminated as a map type. Those maps 
which did not correlate with any type at or above r = 0.8 were assign- 
ed to an uncorrelated group. 

This process was repeated for each of the three coldest 
months. Table 2 shows the derived map types for each month, the 
number of maps assigned to each type initially, and the number after 
the reassignment procedure. The map types are listed in the order 
in which they were initially developed. This results in a decrease 
in the number of maps correlated with each type because maps correla- 
ted with a given type were eliminated from the sample as the pro- 
cedure progressed. 

Sabin (1974) justifies the use of the threshold value r = 0.8 
by showing that it is a good compromise value. It results in a good 
overall description of pressure regimes, produces an acceptabie 
number of uncorrelated maps, and gives an adequate description of 


the climatology within each type. 
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Table 2 


Key dates of monthly and seasonal! map types with the number 
of maps before/after reassignment in the development sample 


(12Z maps, 1954-1971). 


DECEMBER JANUARY FEBRUARY 
Number Map Number Map Number Map Number 
of Type in each Type in each Type in each 
Types Date Type Date Type Date Type 
l 62,1213) 662/36 570122 90/62 650207 57/44 
2 621227 53/38 690139 50/34 640217 49/37 
3 591222 46/35 560101 42/35 550225) 941/35 
h 621216 32/30 570124 38/30 640222 30/32 
5 Swan vay: 610108 30/32 600202 25/31 
6 63122 12823/26 550111 28/26 600223 19/20 
7 681223 18/20 650126 19/26 SHOZ Il 7/17. 
8 561219 16/14 590128 15/26 690207 16/20 
9 OO1203 413/17, 540101 14/15 590206 12/13 
10 6212209 41/11 500131 eahi/ a ooze nla s/w 
1] 5/1230 14723 710108 10/16 600210 10/11 
12 661205 10/11 “680105 10/11 560210 10/11 
13 551209 10/14 ESO) Sma Ont 650211 9/10 
14 671204 8/12 540102 9/1] 580213 9/10 
15 63122] 8/20 610131 8/19 680207 8/9 
16 621222 8/20 640120 7/10 5702} 8/9 
i, 611219 8/1) 600103 6/9 680219 6/6 
18 601219 Th 560117 6/7 630216 6/16 
nS 701203 6/7 550124 6/8 600216 6/7 
20 591227 6/8 550n 3 6/6 


2] B25 967.13 
Pas 541227 6/7 


Uncorrelated 158 143 159 


Total Maps boy 558 508 


1The final seasonal map types are underlined. 
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As would be expected, the reassignment procedure reduced 
the number of maps assigned to the more numerous types and increased 
the number assigned to most of the less numerous types. There was 
little change in the order of predominance of the more numerous 
types, but there were substantial changes in the order of those 
types which were initially not very frequent. For example, Map Type 
18 in February became the ninth most frequent type after reassignment, 
and Types 15 and 16 in December moved up to seventh in the order of 
frequency. 

To obtain the cold-season types, all 61 monthly map types 
were correlated with each other using the correlation coefficient 
threshold of r = 0.8. The correlation procedure was the same as 
that used previously, except that there was no reassignment step, and 
those maps not eliminated in the initial assignment were designated 
as final seasonal map types. This procedure resulted in 24 cold- 
season map types, and the respective key dates for these types are 
underlined in Table 2. The key date of each map type and the corres- 


ponding grid-point pressure values are listed in Appendix |]. 


3.2 Assigning Maps to Map Types 


After the surface pressure data had been corrected and the 


data base expanded to include 1972 data, each of the 3814 00Z and 12Z 


maps were correlated with the 24 map types. The maps were assigned to 


the map type with which they correlated most highly at or above r = Dace 


If the maximum correlation coefficient between a given map and al] 


of the types was less than the threshold value, then the map was 
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assigned to a group of maps designated as uncorrelated Map Type U. 
The common feature of these maps is their non-conformity with any of 
the 24 map types. For this reason they are treated as a distinct 
group of their own so that Map Type U becomes the 25th ''map type''. 

Of all the maps assigned, 34 percent had a maximum correla- 
tion coefficient less than r = 0.8. This is a relatively high pro- 
portion of Map Type U, compared to the 20-30 percent of uncorrelated 
maps in the catalogues developed by the Map-Typing Project Office in 
Colorado Springs. The proportion of uncorrelated maps can easily 
be reduced by lowering the threshold correlation coefficient used 
in the assignment procedure. The use of threshold values of r = 0.75 
and r = 0.70 resulted in the reduction of uncorrelated maps to 21 and 
13 percent, respectively. 

Lowering the threshold value of r reduces the average 
correlation coefficient of all maps assigned to a particular type, 
thereby ''diluting'' the distinctiveness of each set of map types. 

This will only be a problem in this study if the distinctiveness of 
the weather associated with each set of map types is also blurred. 
Verification tests were performed on the probability forecast model 

to assess the effects of using map-type data assigned at the threshold 
levels of r = 0.75 and r = 0.70. The uncorrelated maps were in- 
cluded as predictors during these tests. The verification results 

of these ceiling and visibility forecasts will be examined in 

Chapter VI. 

No attempt was made to test the model using map types 
assigned at thresholds higher than r = 0.8 hecause of the undesira- 


bility of increasing the proportion of uncorrelated maps. Any such 
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increase would be at the expense of the maps assigned to the 24 
correlated types. This reduction in numbers would result ina 
decrease in the reliability of the probability. statistics derived 
from the 24 map-type predictors. 

Increasing the data base by combining monthly data into 
a relatively uniform season was the most obvious way to increase 
the reliability of the probability statistics. Another way to in- 
crease the number of hourly observations associated with a given 
map type was to consider an additional type when a map is correlated 
above r = 0.80 with two maps and the difference between the correla- 
tion coefficients is small. In such cases the hourly data are 
associated with both types. It was arbitrarily decided by the Map- 
Typing Project Office to follow this procedure when the second- 
highest correlation coefficient was within 0.05 of the highest 
correlation coefficient. This procedure was followed in this study. 
The effects of using map-type predictors based on this artificially 
expanded data base are assessed in Chapter VI. 

The complete results of the map-type assignment procedure 
are listed in Appendix 2. The dates of each map are listed in 
chronological order, followed on the same line by the highest 
correlation coefficient and associated map type resulting from the 
correlation between the map and the 24 map types. An ''S'', ''M'' or 'W!! 
attached te the map type designator ciassifies the average pressure 
gradient of the map as being strong, medium or weak, respectively. 
Listed next, and on the same line, is the second-highest correlation 
coefficient. It is followed by the associated map type if r > 0.8. 


When the second map type is listed and the difference between the 
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highest and second highest correlation coefficient is less than or 
equal to 0.05, the second map type is marked with an asterisk (*). 

If the map is of Type U, a group of asterisks takes the Niece of the 
second highest correlation coefficient, followed by the map type with 
which Type U correlates most highly. This pertinent feature regard- 
ing uncorrelated maps was unfortunately omitted from the map-type 


catalogues developed by the Map-Typing Project Office. 
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CHAPTER IV 


MAP-TYPE GHARACTERISHICS 


4.1 Map-Type Occurrence Statistics 


The individual occurrence statistics for each map type, 
including the uncorrelated maps, are given in Appendix 3. At the 
top of each page is an actual, dated surface weather map showing 
the isobaric configuration of the key map. All of the maps in each 
type correlate most highly with the key map, and the correlation 
coefficient is greater than or equal to r = 0.8. Beneath the key 
map are the characteristics of the map type, stratified by season 
and by month. The seasonal statistics were derived from 3700 maps 
of synoptic patterns observed in 26 cold seasons, from the winter of 
1946-47 to the winter of 1971-72. The monthly statistics for January 
and February 1946, and for December 1972 are not included in the 
seasonal characteristics, but are included in the monthly character- 
istics. The correlated map types in Appendix 3 are numbered and 
listed in the order of their frequency of occurrence during the cold 
season. The uncorrelated maps of Map Type U have their characteristics 


listed on the last page of the appendix. The predominance of un- 
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correlated maps is consistent through each month of the cold season, 
with the highest percentage (36 percent) occurring during December. 
The frequencies of occurrence of the predominant correlated types 
will now be discussed. 

Map Type | is the predominant type throughout the cold 
season, with a frequency maximum of 13 percent in January. This 
compares with seven percent in December and eight percent in February. 
Since January is the coldest winter month, it is not surprising 
that the most frequent map type is one which features a cold Arctic 
high-pressure ridge paralleling the Mackenzie River Valley from the 
Beaufort Sea into northeastern Alberta. 

A low-pressure system located in the Gulf of Alaska is a 
very common synoptic situation during the winter months. When this 
low is well developed and located in the northeastern part of the 
Gulf, the Mackenzie ve nley Arctic ridge is often forced eastward into 
the District of Keewatin. This synoptic development results ina 
southeasterly pressure gradient over the Mackenzie Valley, the Yukon 
and eastern Alaska. Map Type 2 has this isobaric configuration. It 
occurs consistently about seven percent of the time throughout the 
cold season. In December and February it slightly exceeds the 
frequency of Map Type 1. 

Map Types 3 and 4 have nearly identical frequencies of 
occurrence throughout the cold season, and follow a monthly occurrence 
pattern similar to Map Type 1. They both have frequencies of five 
and three percent, respectively, in December and February, and maxi-~ 
mum monthly occurrences of eight percent in January. Both map patterns 


are dominated by Arctic high-pressure centers, which may account for 
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their relatively high occurrence frequency in January. The high- 
pressure area in Type 3 is centered just southwest of Norman Wells 
while Type 4 has a high centered over the Yukon, just north of 
Whitehorse. 

Map Type 5 has a trough of low pressure extending along the 
Arctic coast from a low-pressure system over Alaska. This configura- 
tion produces a southwesterly flow over most of the window, with a 
resultant influx of mild air south of the trough. As would be ex- 
pected, this type is predominant in December, the mildest of the three 
cold months. 

The five most frequent types account for nearly one-third 
of all the occurrences in the 26 winters. Despite the fact that the 
three months are well] within the winter season, there are changes in 
the map pattern occurrences that are climatically consistent with the 


advance of the season. 


4,2 Annual Variability in Map-Type Occurrences 


Map types show considerable variation in frequency of 
occurrence from year to year, as can be seen by examining Table 3, 
which shows the maximum annual anomalies of seasonal and monthly 
occurrences for all types. The absolute differences between the 
percent frequency for a given year, and the averages over all 27 
years, were compared for each map type. Those types with the greatest 
absolute differences are listed in Table 3. This method of determin- 
ing anomalies was chosen because it highlights the characteristics 


of the more frequently occurring types. Occasionally, though, a type 
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Table 3 


Maximum annual anomalies of seasonal and monthly occurrences! 


January February 


December 


Season 


Year 
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The format under each time period is as follows: 


Map Type - Percent Frequency (Average Percent Frequency over al] years). 


Negative occurrence anomalies are underlined. 
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that has a low frequency will appear as the maximum anomaly. Map 
Type 18, for example, occurred with a frequency of 11.3 percent in 
the 1952-53 cold season, which is about eight times higher than its 
average frequency of 1.4 percent. 

The two most /“requent patterns, Type U and Type 1, are also 
the dominant anomalies: they both occurred 13 times as monthly 
anomalies. Moreover, on a seasonal basis, Type U appears as an 
anomaly eight times, and Type 1 six times. These two types predomin- 
ate to an even greater extent those maximum anomalies that arise due 
to a frequency that is much lower than average. These negative- 
occurrence anomalies are underlined in Table 3. 

The highest frequency anomaly appeared in January, 1968, 
when Type U occurred some 56 percent of the time. Of the correlated 
maps, Type | had the highest anomaly when it occurred with a frequency 
of some 37 percent in January, 1959. This was almost three times its 
average value of 13 percent and the difference from the average was 
the largest of any map type including Type U. Types 1 and U also had 
the highest seasonal anomalies for correlated and uncorrelated types; 
23 percent in 1958-59 and 45 percent in 1948-49, respectively. 

Map Type 23 had the maximum anomaly - the greatest increase 
relative to its average frequency - with an eight percent occurrence 
in December, 1968. This is 16 times higher than its monthly average 
of 0.5 percent. The most anomalous season was 1958-59 with summed 
absolute differences for the season and the individual montns equalling 
62.2 percent. In the least anomalous season, 1946-47, the sum of the 


differences equalled 28.6 percent. 
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The season with the greatest variety of map types was 
1965-66, when all types except Type 24 occurred at least once. This 
season also had a very high frequency of uncorrelated maps (42 percent). 
This suggests that the 1965-66 season was characterized by frequent 
changes in the pressure patterns with a minimum of map-type persistence. 
Clearly the persistence of map types affects the variability of their 
occurrence frequencies; this relationship is examined in the next 


section. 


4.3 Map-Type Persistence 


The HEaPeESOF persistence of individual map types can be 
determined by examining the most 4requent duration characteristic, 
a quantity listed in Appendix 3. The term persistence is used to 
denote two or more consecutive occurrences of a map type which has 
been assigned at i2-hourly intervals, using a threshold correlation 
coefficient of r = 0.8. The persistence information is based only on 
15 to 16 years of data when both 00Z and 12Z data were available. It 
should be noted that the frequency of consecutive occurrences is the 
pereent sfrequency of arolips (1), 25.3... ete.) of eccurrences, not 
the percentage of maps that fall within a group. This form con- 
veniently gives the percent probability of consecutive occurrences 
after a given initial occurrence. This is useful prognostic informa- 
tion. 

Over the entire season, Map Type 1 is the most persistent 
configuration, appearing as a group of two or more consecutive 


occurrences 53 percent of the time. Map Types 4, U, 2, 3, 5 and 6 
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are the next six most persistent types. It is no coincidence that 
these most persistent types are also among the most frequently occur- 
ring types. The good relationship between frequency and persistence 
is further substantiated by the fact that Map Types 1 and U share the 
longest run of 11] consecutive occurrences. However, this relationship 
is not exact and, in the case of less frequently occurring types, 

the correspondence is poor. Map Type 11, for example, is the 19th 
most persistent type, and Map Type 22 is the 15th most persistent 
type. 

The persistence of all map types combined can best be 
examined by considering the percentage of maps that fall into a 
group of two or more consecutive occurrences. For those years 
when 00Z and 12Z data were available, some 65 percent of the maps 
appear in sequences of two or more consecutive map-type occurrences. 
The random probability of two consecutive occurrences is 14.6 percent 
compared with the actual frequency of 27.2 percent. Synoptic map 
patterns are, therefore, persistent features over the Mackenzie 
Valley during the coldest winter months. 

Each of the seven most persistent types appears at least 
three times as a maximum anomaly, as shown in Table 3. Despite this 
good correspondence, not all occurrence anomalies are associated with 
a persistent map type. Thus, Type 18 is the least persistent, appear- 
ing as a single occurrence 90 percent of the time. In February, 1953, 
it occurred four times, al] non-consecutively; this is the maximum 
anomaly for February. The non-persistency of Type 18, and its 


relationship to map-type sequences is discussed in the next section. 
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4.4 Sequences of Map Types 


In Appendix 3, the types most frequently following each of 
a given map type are listed in order of their frequency of following 
occurrence. To glean information on a sequence of more than two 12- 
hourly occurrences, the following-type information on a particular, 
most frequently following type should be consulted. 

Two features of the following-type data are prominent and 
generally consistent with previous remarks. Map Type U is the most 
frequently following type for 13 of the 25 seasonal map types. This 
appears reasonable in view of the very high frequency of occurrence 
of uncorrelated maps. Ten of the twelve remaining map types follow 
themselves most frequently. Included in these 10 types are the seven 
most persistent types mentioned in the previous section. This is 
entirely consistent with the conclusion that the surface map patterns 
are very persistent during the cold season. 

A different explanation is required to account for the 
uncorrelated maps being relatively more predominant as a following 
type, than as an occurring type. In the light of the findings of the 
preceding paragraph, it can be concluded that only two map types evolve 
frequently into another correlated map type. Ninety-two percent of 
the types most frequently persist or are followed by an uncorrelated 
map. This general pattern of synoptic evolution is in agreement with 
Burns' (1970) climatic study of the Mackenzie Valley. He found that 
the cold dome of Arctic air that prevails over the valley during 
winter forms a block to the migrating frontal lows. This blocking 


action would seem to account for the high persistence of map types, 
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and the limited degree of map-type evolution. 

The highest frequency of following occurrence is 60 percent 
when Type U follows Type 23. This map type follows itself 27 percent 
of the time and, therefore, only evolves into another correlated type 
13 percent of the time. This behavior is not unexpected because the 
key map shows no closed pressure center, but only a broad trough 
extending north over Great Slave Lake, and northwest to the Mackenzie 
delta. This configuration also has one of the lowest average pressure 
gradients of all the correlated types. 

The second-highest frequency of following occurrence (52 
percent) is ascribed to Map Type 2, following Type 18. From the key 
map, this sequence shows a low-pressure center moving southeastward 
out of northeastern Alberta. A high-pressure center over Banks 
Island moves southward while an associated ridge builds in behind a 
migrating low. It is significant and appropriate that Type 18, the 
least persistent of all, also appears in the most frequent map-type 


sequence. 


4,5 Mean Pressure Characteristics of Map Types 


One of the most significant aspects of the correlation 
method of selecting map types is that the maps assigned to a type are 
only similar in respect to their isobaric configurations and direction 
of flow patterns. Scholefield (1973) showed sit the correlation 
coefficient between two maps of identical configuration does not 
change when one of the maps is altered with respect to its pressure 


gradient or its overall pressure magnitude. This characteristic wil] 
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become evident during the analysis of gradients and mean pressures. 

During the map-type assignment procedure, the average of 
the MSL pressure values at the 20 grid points was calculated for each 
map. After the maps were assigned, the mean values for each map 
within a type were averaged. These mean map-type pressures, minus 
1000 mb, are listed with the map-type characteristics in Appendix 3. 

Map Types 20, 23 and 24 have the highest mean pressure, 
all being very close to 1026 mb. A quick glance at the key maps 
shows Map Types 20 and 24 to be dominated by high-pressure centers 
and ridges. The reason for the high mean pressure is not obvious in 
the Type 23 key map, where a low pressure trough appears to be the 
major feature. Type 23 is a good example of how much the magnitude 
and gradient of isobars within the member of a type can vary. The 
key map has the Jowest mean pressure (1010.4 mb) of all the maps of 
Type 23. Its pressure Pee ent of 3.06 mb/grid interval is also 
well below the type average of 4.04. These values are in sharp con- 
trast to the monthly mean average pressure of 1032.8 mb and mean 
pressure gradient of 4.29 mb/grid interval of the six Type 23 maps 
of December. The key map does show a weak high-pressure ridge ex- 
tending from the Yukon into the southern Mackenzie Valley. The 
intensity of this ridge must be very marked in the December maps. 

Map Types 3, |] and 4 have previously been mentioned as types 
that are dominated by Arctic high-pressure systems. These types along 
with Map Type 8 are in the next-highest group of mean pressures in 
the range 1024-1025 mb. They all have monthly maximum pressures in 


January, a consequence of the intensity of the Arctic high pressure 


+ 


- - - 7 J _ 
v . : AbW a y >) 7 a> 
a) ee re ~ nvige i opti ~ 1G, oy 
,@3 eto 1] Cagn Ain of aon ie 5 ; sab aul 7 sis ‘ Mia 
j t 7 >. —.. - oe _ - 
Pt : a - ay I : , s A i 7 
eer ty a (inbasony | onlene ana Set ws — 
_ 5 . a2 ‘ _ 
af a in nt 
a. 5 P ; <i eae Be 1? Tue tal YS 3 hi. Gg 
tly -) : ie ystes Piw ein i a Be os 7 / v ’ ns pee 
os ei Ne? (2a ley Vike ate oe bdaben ke al shy ov al 
iene i | = 
: ry . ‘- : . i 
3 came igene Uaioe Coen aewt) | (APeeEtove .s'teN aint = iis 
La ie ae ’ ; 4 ae a mites wf “ Tye j : i + a al Deo! 
cc. : fa 
ra : - 
Fw 4 aff te ‘ eh) i Ms { uy) f $ - Ms v Oy i { u sh Be 
7 a - t 
sh ail 4 
t vy & avy t } fi ; LP I whl a 14 ‘ ay = v he si anis 7 i 
: . i 
>* 4 f é ' : Fay oH" 
~ Herd eA TOR Pasa dt att fs 
i 4 ‘ ; 4 Et 3 1 ’ od, ve 
ve. ; en Ree 
iS ached ack ne daohs Sreeeare | eyes 
i f f ey < eel pea 
- ' - 
ae ‘ 4 ao 
34 : 3 i 'S 4 . ye 
_ =" r] 7 
‘ ou ’ ae: #7 
" = - ” F == a 
36 AG ' yeh f I $7 } . is R / 
ine - + is 
; : : ea ery OF FED: iano eg 
- } + ey 
+ i 4 a | 7 Lé 5 tat 3 Put : : oer sin | io 
2 ) : 
“x6. Sati’ svyeenverntty cl eye S-eS 2am x .. yar way he re 
. : oy 
any. <iyabl a) 2ieetioeh Gyehtuce «ett aPt ae wiht wel 
) 7 — ' an 
sp 2Qeit autesoe) Oey) weit ip ‘oN wel Let 5 oli pes aie’ 
., 7 = 7 = F 7 ¥ 2 a 7. 
a4 7 ’ “ : z ‘ 
peat 6. a} Sf ie my ¥ i gue doergt ws ts aot? is f } 
7 4° ane 
— 7 a - » ae 
pie be autres e2bhT (aa) bees ii oe Aine Hy? BSA 2% tA. wp 
a 9 7 ‘iD 7 
an . ~ aie, Ad wa ark 


Po a é 
a) eyiee ris nota Te < oan 


a atents adaor’ a 
oer re slg (eh 


1A, : 


systems in this coldest month. This expected relationship is not 
obvious in the group with the highest mean pressures, but their low 
frequencies of occurrence make the monthly statistics unreliable. 

Map Type 12 has the lowest mean pressure of 1011.7 mb. The 
range in average pressu.es of maps of this type is greater than for 
Type 23. Thus the Type 12 map of January 22, 1960 has an average 
pressure of 1033 mb, while the map of January 1, 1948 has an average 


pressure of only 990.1 mb. 


4.6 Pressure Gradients of Map Types 


Over relatively uniform topography, the strength of the 
low-level winds is proportional to the surface pressure gradient. 
The gradient is also a good indicator of the intensity of nearby 
pressure systems. Both wind speed and pressure-system intensity are 
important weather elements, but the correlation procedure does not 
resolve such features. This is the principal weakness of this map- 
typing technique. To alleviate this problem it was decided to in- 
vestigate the pressure gradient characteristics of map types sub- 
jectively by attempting to subdivide the maps assigned to each type 
according to their pressure gradients. 

The absolute value of the pressure aredient can be easily 
calculated from grid-point pressure values using the following five- 


point grid formula: 


Gradient (ei) mae ASG aX Nie sai(Xaett Xp)? liamamby Gt 


where X, ,X., and X,,X, refer to adjacent pairs of grid points 
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surrounding grid point X.. 

The gradient about a grid point may vary considerably from 
point to point throughout the window. A specific gradient value was 
assigned to a map by averaging the absolute values of the gradients 
at all eight interior grid points. As part of the assignment process, 
the standard deviations of the grid-point pressures and the differ- 
ences between maximum and minimum values were also calculated as 
indicators of gradient. The mean of the absolute gradient about the 
eight interior grid points was chosen to define map pressure-gradients 
because it was more comprehensive than the other indicators. The 
values are expressed in logical gradient units of mb/grid interval 
(gi) and the values may be evaluated at any one of the eight locations 
within the window. 

It was arbitrarily decided to subdivide the map type into 
three classes based on the standard deviation (s.d.) of the mean 
gradients of all maps within a type. The mean gradients that are 
within one s.d. of the total map-type mean are classified as ''medium''. 
The gradients that are more than one standard deviation below the 
mean are classified as ''weak'' and those more than one s.d. above the 
mean ''strong''. The critical value of the standard deviation for 
each map type is listed in Appendix | along with the grid-point 
pressures for the key taps. 

Appendix 3 contains the mean gradient characteristics of 
each type in units of mb/gi. The mean maximum and minimum gradients 
were calculated by taking the average of the highest and lowest 
values, respectively, that occurred at the eight central grid points 


on each map. 
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A singular feature of the mean gradient statistics is the 
generally weak gradients associated with uncorrelated maps. The 
mean pressure gradient of Type U maps is only 4.04 mb/gi which is the 
lowest. Map Type 23 also has a low value of 4.04 mb/gi, but this stat- 
istic is questionable because there were only 17 occurrences of this 
type. The mean minimum and maximum gradients of 1.57 and 7.03 mg/gi 
for Map Type U are also very low. The lowest mean gradient for any 
map is found on the 12Z uncorrelated map of January 17, 1961 with a 
value of only 0.65 mb/gi. The weak gradient characteristic of un- 
correlated maps is a good reason for grouping them into a separate 
Map Type U. 

The similarity in characteristics of Types 3 and 4 shows 
up also in their maximum mean gradients of 6.61 and 6.07 mb/gi, 
respectively. They also have the highest mean maximum gradients. 

The Type 4 map of 00Z, January 16, 1957 has the highest individual 
mean-map gradient of 15.03 mb/gi. The highest gradient present at 
one grid point was 22.64 mb/gi on the Type | map of January 15, 1957. 
Individual grid-point gradients of 0.0 mb/gi are also found on 
occasion. 

The differences in gradients between map types are apparent, 
but they are small compared to some of the differences between the 
gradients within the same type. The difference between mean gradients 
of the relatively strong gradient Type 3 and weak gradient Type U is 
only 2.57 mb/gi. There are a couple of individual maps of Type 3 
with gradients less than 3.0 mb/gi and several uncorrelated maps with 
mean gradients in excess of 10 mb/gi. These large in-type gradient 


differences illustrate the inability of the correlation technique to 
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discriminate between gradients. For this reason the map types wil] 
be stratified by gradients when testing a simple probability model 


relating ceilings and visibilities to map types. 
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CHAPTER V 


RELATING YELLOWKNIFE WEATHER TO MAP TYPES 


5.1 Climatic Averages and Anomalies 


The characteristic climatic feature of the Yellowknife 
winter is the cold weather which, as noted in Chapter IV, is related 
to Arctic high-pressure systems. In the climatic data there is good 
evidence of a quantitative relationship between low temperature 
regimes and the occurrence of certain map types. In 1949-50, the 
coldest of the 26 seasons, the mean daily temperature was =037 6. As 
shown in Table 3, Type 1 has the maximum seasonal anomaly, while 
Types 3 and 4 have maximum monthly anomalies of occurrence during this 
coldest season. Types 1, 3 and 4 also appear as anomalies in the 
next four coldest seasons, in 1946-47, 1948-49, 1951-52 and 1955-56. 

lt is interesting that the five coldest winters occurred 
in the earlier part of the 26-year data period. The five-year moving 
averages, calculated for the entire period, show a pronounced warming 
trend through the 1950's. There was no obvious corresponding trend 
in map-type occurrences. However, the negative-occurrence anomaly of 


Type 1 in the 1959-60 season is significant, because it was the 
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Warmest season, with a mean temperature of 009 Fe 

The moving averages showed no well-defined temperature 
trend through the 1960's, but a cooling trend developed during the 
last three winters of the decade. The winter of 1971-72 was one of 
the coldest since 1955-56, with the mean temperature dropping to . 
-12,8°F. Associated with this cold season were maximum occurrence 
anomalies of Types | and 4, 

The maximum precipitation recorded at Yellowknife during 
any season was 3.15 inches in 1960-61, with one-half falling in 
January, 1961. Referring again to Table 3, it is seen that Type 6 
was the maximum occurrence anomaly during this snowy month, present 
some 23 percent of the time. The key map for Type 6 shows a low 
pressure system in northwestern Saskatchewan with an easterly circula- 
tion over Great Slave Lake, a favorable synoptic situation for pre- 
ecipltation. 

Precipitation was recorded on 51 days of the 1957-58 season, 
the highest number of precipitation days in any of the seasons. A 
total of 2.82 inches of precipitation fell during this period, the 
second highest seasonal amount. Type 6 again appears in Table 3 as 
a maximum occurrence anomaly of 19 percent in December, when 1.27 
inches of precipitation fell. Type 2 is the maximum anomaly for the 
month of January and the entire eee one The key map for Type 2 shows 
the Arctic high east of Great Slave Lake, with a southeasterly flow 
over most of the window. A well-developed Gulf-of-Alaska low is the 
dominant feature outside the window. This synoptic situation favors 
the advection of moist, relatively mild Pacific air into the Mackenzie 


Valley, overrunning the dome of cold Arctic air and producing cloud 
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and precipitation. 

Based on average conditions these pronounced anomalies 
indicate a fairly direct relationship between some of the map types 
and the weather at Yellowknife. To investigate this relationship in 
more depth, the hourly veather observations pertinent to each map type 
were examined in detail. The results of this study follow in the next 


section. 


5.2 Relating Yellowknife Hourly Weather to Map Types 


The Yellowknife hourly weather observations from January, 
1953 to December, 1968 were analyzed as follows: the occurrences of 
weather parameters at three hours prior to map time, at map time and 
at three hours after map time were summed. This gives a six-hour 
associated weather period, centered around the time of a map-occurrence. 
There is also no overlap in the observations associated with types 
assigned at 12-hourly intervals. These 16 seasons of hourly data 
form the dependent data sample from which a conditional probability 
forecast model was developed. The three-hour interval between observa- 
tions corresponds to that used in the forecast model. 

The calculated statistics were based on the total number 
of weather-parameter occurrences associated with each type. Each 
category of ceiling, visibility and wind direction is treated as a 
separate parameter. For each type, the frequency of a weather para- 
meter was calculated relative to the same parameter occurrence 
associated with other types. These relative frequencies are very 
strongly dependent on the number of type occurrences. The frequency 


of parameter occurrence relative to the map type occurrence gives a 
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much better indication of the association between weather and map 
types. This frequency was calculated by dividing the number of hour- 
ly observations of a parameter by the total number of hours associated 
with the corresponding map type. Such a frequency can be interpreted 
as the conditional probability of the parameter occurring, given a 
map-type occurrence. 

Table 4 lists the four best associations for 11 weather 
parameters. In the center of the table are the parameter ceSerin wine? 
including the total number of parameter occurrences and climatic 
frequency over the l6-year period. Listed to the right are the 
number of hourly parameter occurrences, the frequencies relative to 
the parameter and those relative to the associated map type. The 
statistics describing each associated map type are listed on the left 
side of the Table. The statistics on each parameter are listed in 
the order of the degree of association with the related type, as 


measured by the frequency relative to the type. 


5.3 Ceilings, Visibilities and Precipitation 


Ceilings and visibilities below VFR limits, and precipitation 
are the most significant aviation weather parameters; they are also 
most difficult to forecast. Frequently these three ''poor-weather"' 
elements occur simultaneously with certain synoptic situations. Map 
Type 6 provides a good example: it shows a relatively high degree of 
association with all three elements. Indications of this ''poor- 
weather’! association with Type 6 appeared previously in section 5.1 


during the analysis of climatic anomalies. 
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Table 4 


Significant weather parameter - map-type associations, 
based. on Yellowknife hourly weather observations at 
all map times and at three hours before and after, 


during 16 years, 1953-1968. 
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Map Wea. Type 
Type Num Freq! Weather Parameter Num Freq! Freq! 
14 48 he Low Ceilings 24 4.9 Vrs 
6 105 h 3 (<1000 ft) hs Gist 14.3 
1] 51 2 Total Num = 488 17 oe [st a 
5 130 5.3 Clim Freq = 6.62% 43 8.8 TRO 
6 105 43 Low Visibilities 48 ory ne 
12 48 as (<3 miles) 21 4.2 14.6 
WW 48 1.9 Total Num = 495 Wye 3.4 ks 
1] 51 24/1 Clim Freq = 6.7% WW 3.4 Tiley 
19 33 les Precipitation 65 2.4 65.7 
6 105 4.3 193 fee: 61.3 
i 46 9 Total Num = 2680 82 Bt, 59.4 
13 hg LAY, Clim Freq = 36.22 84 341 SiH 
2h ge Or3 High Ceilings 2) Soa 10080 
23 12 OF5 (>5000 ft) 35 0.6 97.2 
16 ho 1.6 Total Num = 5570 Ws 250 94.2 
10 54 Zee Clim Freq = 75.3% 149 2) | 92.0 
20 20 0.8 Good Visibilities 60 Org 100.0 
10 bige  242 (>6 mi) 160 2.5 98.8 
24 8 0.3 Total Num = 6357 23 0.4 95.8 
3 127, Sel Clim Freq = 85.9% 351 SED Ozh 
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Table 4 continued: 


3) 


Map ; 


Weather Parameter 


Num 


Type 
Freq! 


Type Num. Freq! 


l 209 on 


3 127 Del 


19 38 \e3 
23 12 O55 
13 49 2) 
i) 107 43 
1] 54 de’ 
12 L8 los 
2 169 6.9 
15 46 }.9 
5 130 She 5: 
17 48 1.9 
4 11] 4S 
14 48 1.9 
3 127 Byes 
10 by 220 
l 209 8.5 
20 20 0.8 
17 48 1.9 
8 67 Peat 
16 te) pale 
h 111 4.5 


Wind > 12 MPH 


1487 
Clim Freq = 20.12 


Total Num 


North Winds 
(NNW-NE) 
Total Num = 2024 
Climepreda=e2 7.434 


East Winds 
(ENE-SE) 
Total Num = 2600 
Clim Freq = 35.12% 


South Winds 
(SSE-SW) 
Total Num = 571 
Clim Freq = 7.7% 


West Winds 
(WSW-NW) 
Total Num 1866 


Done 


Clim Freq 


Calm Winds 
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Total Num 
Clim Freq = 4.6% 
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Low visibilities and ceilings seem to be related in the 
synoptic situations of Type 11, because both elements occur together 
some 1] percent of the time with Type 1] regimes. The key map for 
Type Il has a weak trough extending into the southern Mackenzie Valley 
from a low-pressure cencer just north of Banks Island. The resulting 
southeasterly flow over Yellowknife is conducive to the development 
of low ceilings and visibilities. The key map of Type 14 also shows 
a southeasterly flow over Yellowknife. In this case the trough runs 
along the 60th parallel from an Alaskan Gulf Low. Type 14 regimes 
produce low ceilings 16.7 percent of the time, which is the highest 
frequency of low ceilings associated with any type (see Table 4). 

Despite the association between the ''poor-weather'' elements, 
the precipitation frequencies are much greater than the low-ceiling 
and visibility firrequencies. This suggests that much of the precipita- 
tion falls from higher clouds or the intensity is low. This pre- 
cipitation characteristic can be attributed to the predominance of 
thesAreticualne which is! usually very «dry a sginikluxes of milder, moist 
ai into, the region are forced: to mise over the cold Arcticrdome, 
forming clouds above the Arctic inversion. Some of the precipitation 
that is released from these clouds may never reach the ground due to 
sublimation in the dry Arctic air. 

Fresh southward surges of Arctic air through the Mackenzie 
Valley and into Alberta are often accompanied by extensive areas of 
cloud and light snow, especially north of the Arctic Front. The 
Type 19 key map is a good example of this synoptic situation. Some 


66 percent of the observations associated with Type 19 reported 
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precipitation. Types 13 and 15 are two other precipitation types 
listed in Table 4. Their key maps show a similar easterly circula- 
tion pattern over Great Slave Lake. Air-mass convergence and over- 
running of moist air from low-pressure systems in northern Alberta 
account for the high association of precipitation with regimes of 
Types 13 and 15. 

The predominance of ''good weather'’ at Yellowknife during 
the cold season is clearly indicated by the high climatic frequencies 
of 75.3 and 85.9 percent, respectively, for high ceilings and good 
visibilities. Some of the map types whose key maps are dominated by 
high pressure systems have considerably higher frequencies of good 
weather associated with them. Table 4 shows that both Map Types 24 
and 20 have 100 percent of their associated observations in the 
highest ceiling jand visibility categories, respectively. The other 
types listed are associated with high-category observations in excess 
of 90 percent of the time. Map types are, therefore, much better 


discriminators of ''good weather'' than ''poor weather'"'. 


5.4 Winds 


Strong winds are a significant aviation weather parameter. 
Table 4 shows that wind speeds greater than 12 miles per hour occur 
less frequently than precipitation, but more frequently than low 
ceilings and visibilities. As is the case for al] parameters listed 
in the table, the frequency of the parameter associated with given 
map types is considerably greater than the climatic frequency. The 


most significant feature of this section of the table is the presence 
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of Types 1 and 3. Their association with strong winds is undoubtedly 
related to their previously described strong pressure gradients. The 
converse relationship between weak gradient map types and calm winds 
is not pronounced. 

All maps belonging to a given type have very similar flow 
patterns. This is clearly illustrated by the high degree of assoc- 
iation between map type and wind direction. Table 4 shows that 92 
percent of the observations grouped with Type 11 have easterly winds. 
The other wind directions also exhibit high degrees of association 
with specific map types, with the possible exception of south winds 
which have a low climatic frequency of only 7.7 percent. 

The absence of Type U from Table 4 shows that there are no 
weather parameters that are highly associated with uncorrelated maps. 
Most of the associations in Table 4 show the parameter frequencies of 
occurrence with map nee to be greater than twice the climatic 
frequencies of these parameters. This suggests close relationships 
between map types and synoptic weather. The next chapter will examine 
the possibilities of using these relationships to predict weather in 


an independent data sample. 
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CHAPTER VI 


PREDICTING CEILINGS AND VISIBILITIES AT YELLOWKNIFE 


BASED ON MAP TYPES 


6.1 Developing the Probability Forecast Model 


The computer program that determined the association of 
weather parameters with map types also calculated and stored for 
future use the probabilities of occurrence of the associated para- 
meters over the 16-year dependent data period. These conditional 
probabilities were determined for 1] separate times associated with 
each map-type occurrence. The times were at three-hourly intervals; 
from six hours prior to map time up to 24 hours after a map type 
occurrence. Separate calculations were made for those observations 
associated with 00Z maps, 12Z maps and combined 00Z and 12Z maps. 
Climatic probabilities were also calculated using the identical 
procedure. For all climatic calculations, the hourly data were 
stratified only according to the hour of the map occurrence and the 
associated times before and after map time. 

The basicnstatisticalecharacteristiicseo@ thesdependent 
data base are depicted in Table 5. They pertain to the 2467 hourly 


observations made at map time. An identical number of observations 
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Table 5 


Number of occurrences and climatic probabilities of 
ceilingrand Vistbility categories at. 002 and. 122. for 
the months of January, February and December 1953- 


1968. 
00Z 7. 00Z + 122 
Category Num % Prob Num  % Prob Num % Prob 
Ceiling A 1] 1 48 323 59 2.4 
Ceiling B 4] 4.0 55 Bao 96 39 
Ceiling C 185 13%] 277 oeeZ 462 hele? 
Ceiling D 786 76.8 1064 Sof 1850 7530 
Total 1023 100.0 1444 100.0 2467 100.0 
Vistomliey A hy ld, 29 220 6 9 
Visibility B 56 Dos 62 4 3 118 4.8 
Visibility C 70 6.8 123 8.5 193 hee 
Visibility. 0 880 86.0 1230 85.2 Zl 0 85.5 
Total 1023 100.0 1444 100.0 2467 100.0 


are used to calculate probabilities at each of the other ten times 
associated with map types. The gaps in the 00Z map-type data result 
in there being fewer observations associated with O0Z. 

Slight drurnal inf Mences ‘on ther ceilings: and vistbilities 
can be detected by examining their probabilities of occurrence. 
Observations at 12Z have a greater percentage of the "'poor'' weather 
in category A than do the 00Z maps. Good weather in category D, on 
the other hand, occurs more frequently associated with 00Z maps. 

The infrequent occurrences of category A are the principal reason why 
no additional category or monthly stratification was introduced into 


the model. Because of the significance of this weather category to 
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aviation, it is desirable to have the related statistics as stable as 


possible. 


6.2 Testing the Forecast Model 


Once the probability statistics were calculated for all 
types, the results were used to forecast ceiling and visibilities 
according to the prevailing map type. Four years (1969-1972) of map- 
type data and Yellowknife hourly weather were used as the independent 
data sample to test the forecast model. 

The main difficuity in verifying probability forecasts by 
using standard contingency methods is converting the probability fore- 
casts) tO a Categorical forecast. For example, it ts difficult. to 
determine which ceiling category will be forecast, given the proba- 
bility forecasts) for each of the four categories. One solution is to 
assign to each category a weight in proportion to the relative sig- 
nificance of accurately forecasting the category. Each categorical 
probability forecast is multiplied by its respective weight, and 
that category with the highest weighted probability becomes the 
categorical forecast. 

One verification method that indirectly incorporates a 
weighting scheme is the Brier P-score, specifically developed to 
verify probability forecasts. The weighting is accomplished by rais- 
ing the score of a group of categorical forecasts whose probabilities 
are not distributed ideally into one categorical forecast of 100 per- 
cent and the remainder into zero percent. If this measurement of 


the resolution of a forecast was the only criterion used in determin- 
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ing the score, then efforts to improve scores would likely lead to 
probability forecasts being either too high (overforecasting) or too 
low (underforecasting). To account for these possibilities, a further 
penalty is added when the probability of the forecast category does 
not correspond to the frequency of the category's occurrence. When 
there is little difference between the forecast probabilities and 

the frequency of category occurrences, the forecast is said to be 
reliable. 

The resolution and reliability components of the P-Score 
are not at all obvious in the original formula developed by Brier 
(1950). The P-score formula is thoroughly analyzed in Appendix 4, 
where it is transformed into a formula which can be used to verify 
individual category forecasts, rather than a complete group of cate- 
gorical forecasts. The transformed Brier Score formula for N fore- 


casts of an event or category is! 


w 
ll 
| 

i eal =} 


HeAN GC ME ro a TARO Rt eo) rae (2) 


where k refers to one of n probability classes and ty is the probabil- 
ity that represents each class. In this study, I] classes cover the 
full range of probabilities. Representing the lowest class of 


probabilities, from 0-4 percent, is f, = 0.0; the next highest class 


from 5-14 percent is represented by bi 0} LOM ame lon dnd at nea Tanes t 


range of probabilities, from 95-100 percent, is represented by 


fia S200. 


The first term within the brackets of Equation (2) is the 


reliability term, while the second is the resolution term, and oy is 


eee Appendix 4 


i se 
i 7 . | ; oy ” " Le : a 
7 . O21, beat uh bal hb sinw Paras. 


ie Piet =e le 


‘ 
<4) ra a2 tay ; L- eo i ~ psd hy A epee a Ehied fngeiynl 


‘Vad 
— ee ere eee 
asoD YWoveTeS J4E9=: Hey AO ik aeee ary ff v- vt anf > 
a ; hap — 
A, 5 ia ip 
octyl ee Ree tres “wastes att te yoeebpe? )) on 


Kar @u73 casio sananty gad? Aaa Bon? bh hes beef ae 


= 
: 7 ms 7 i Pa . 
; a Wy rae. ae | oe ey “gyfly 
GUST “OVBS 2! 24¢ Oy wont) , esataiiae Wis oPa3, 16 ¥ oF uh nt 1S 
: 1 pan yy = Z ; j ; 7 
} ‘7% 2, _ cP — 
“  tde ie 
037-4 7 : ‘ 
Feye ove 
i 
an, cod 
a. 
J 
az 3 
ay 
. toe! i 
ori Sts 
bral) Jeawet 
F ; ' 


a 


47 


the frequency of the event relative to the number of event forecasts. 
The maximum score of zero occurs when the event probability and 
relative frequency are both equal to zero percent or 100 percent. 
The worst score possible is B= 1. 

A root-mean-square eater in reliability can be defined 
from the reliability term in Equation (2) as 

n 
RMSE = 4° MCF, = 6). (3) 

The RMSE is used in this study to monitor the effect of reducing the 
number of event occurrences through increased stratification of the 
data. Good reliability results from having a suitably large number 
of events in a sample so that the probability statistics are stable. 

Brier Score verification was also applied to the independ- 
ent data forecasts that were made using the climatic probabilities. 
These climatology scores are compared with the scores calculated from 
the forecasts made using map-type-stratified conditional probabilities. 
If both scores were calculated on forecasts of the dependent data, 
then the map-type-stratified forecasts would always show an improve- 
ment over purely climatological forecasts. This will not necessarily 
be the case for map-type-stratified forecasts of independent data, 
for two reasons: first, there is no guarantee that the climatology 
of the independent data is going to be the same as the dependent data. 
Secondly, assuming that there is a relationship between map patterns 
and weather, certain map types will be better predictors than others, 
depending on the strength of the relationship. It is conceivable 


that a map type that is a relatively poor predictor will produce a 
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Brier Score that is worse than a climatology forecast score, when 
the forecasts are made on independent data. 

lt can be seen that the Brier Score is an ideal verification 
method for this study. It is specifically designed to verify proba- 
bility forecasts, aaa gives a convenient measure of the forecast 
reliability as Held as resolution. Moreover, the scores are calculated 
in such a manner that comparisons can readily be made with respect 
to different models, map types, weather elements and categories. 
One of the disadvantages of the method is that it gives no suitable 
measure of the effectiveness of a forecast that is to be used opera- 
tionally. However, the concern of this thesis is to examine possible 
methods that could be used in the development of an operational model. 
When the model appears to be suitable for operational use, then some 


measure of its operational effectiveness should be determined. 


6.3 The Verification Program 


A computer program was developed for verifying four cate- 
gorical forecasts at a time, using cold-season data for four years. 
The input data consisted of 660 maps at all 00Z and 12Z map times, 
7986 hourly Yellowknife weather observations, climatic probabilities 
and conditional probabilities of the four category Bee trren ees The 
program progresses chronologically through the independent data, 
recording the number of times each category occurred and was forecast, 
the probability class in which the correct forecast was made, and for 


which of the 1! associated times the forecast was valid. 
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The results for each category were stored in a four-dimen- 
sional array, with each element of the array containing, in one 
computer word, the total number of forecasts and the number of 
correct forecasts. The four dimensions of the array correspond to 
the map time, the assoc.ated map-type time, the map type and the 
category. The Brier Scores were calculated from the storage arrays, 
and the results were listed in 33 tables. The tables are organized 
into three sets of 1] tables, for the 00Z, 12Z and combined map times, 
respectively. The tables in each set contain results for the 1] 
times associated with each map type. 

Table 6 shows a typical verification table containing re- 
sults fo, ceiling forecasts valid at map, timestoryald OO0Z.and 22 
maps. The average results for each category were calculated by 
weighting each score according to the number of related map types. 
This is equivalent to weighting the scores according to the number 
of forecasts in each probability class as indicated in Equation (2), 
because each map-type score is based on only one probability class. 
For the purpose of comparison, the scores for climatology forecasts 
are listed immediately below the average scores. 

Some characteristics of the scores given in this table 
require explanation. It has been stated that lower P-Scores indicate 
better forecasts. It would appear from Table 6 that the relatively 
rare category-A events are forecast more accurately than the more 
frequent category-D events. This can be explained by recalling that 
the best scores are given to those accurate category forecasts close 
to the limiting values of zero or 100 percent. All category-A 


probability forecasts score very close to zero, and since this 
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Table 6 


pnpexample votethe Verification results fom one of 11 
times associated with all map types and a summary of 
thessemomilievernif ication, tables. 


P~SCORES AWD RELIABILITIFS EASED OH ALL #ZAFS FOR CEILING FORECASTS AT HAP TIBSE * ( 0) HOURS 
TYPE CIG-A CIG-B cIeé-Cc CcIGc-D AVERAGE 


P-SCORE BLBY(%) P-SCCRE RLBY(%) E&-SCORE RLBY(%) P-SCORE BLEY(%) P-SCOEE RLBY (3) 


Qa 0.049 0.24% 0.0 0.0 0.988 0.00 0.095 1.18 0.958 0.36 
8 0.063 0.11 0.0 0.0 0.C 0.0 0.107 6.79 0.042 0.23 
1 0.0 0.0 0.0 0.0 0.221 2.66 0.157 0.00 0.094 0.67 
3 0.0 0.90 0.0 0.0 0.031 0.54 0.031 0.54 0.016 0.27 
6 0.0 0.0 0.1117 1.23 0.268 2.09 0.250 0.C¢8 0.157 6.85 
7 0.0 0.0 0.0 0.0 0.213 6.48 0.210 0.00 0.131 1.62 
2 0.096 0.92 0.056 0.18 0.038 0.43 0.229 C.23 0.105 0.84% 
7 6.0 0.0 0.0 0.0 0.0 0.0 0.010 4.00 0.003 0.25 
49 0.0 0.0 0.110 0.06 0.010 1.00 0.190 0.25 C.077 0.33 
3 0.0 0.0 0.0 0.0 0.0 0.0 0.040 4.00 0.010 1.00 
12 0.6 0.0 0.0 0.0 0.223 0.11 0.227 C.44 0.112 0.14 
5 0.111 23 0.412 0.C8 0.036 0.46 0.214 C.82 0.119 0.65 
V1 0.067 0.44 0.133 1.78 0.250 12.76 0.235 C.06 0.171 3.76 
18 0.167 (2.78 0.90 0.0 0.030 $.00 0.227 0.44 0.121 3.06 
738} 0.0 0.0 0.0 0.0 0.0 0.0 0.000 0.C0 0.006 0.00 
21 0.0 0.0 0.0 0.0 0.040 4.00 0.160 16.00 0.050 5.00 
19 0.0 9.0 0.0 0.0 ~390 20.25 0.360 ZCisi2s 0.1SE5 10.12 
19 0.0 0.0 0.0 0.0 0.143 2.04 0.010 1.00 0.038 0.76 
245 0.0 0.0 0.0 0.0 0.0 0.0 0.000 0.Cc0 c.c00 0.00 
12 9.0683 0.69 0.070 1.00 0.235 0.06 0.260 1.09 0.447 0.69 
20 0.0 0.0 0.0 0.0 0.070 7.00 0.040 4.C0 0.013 1.25 
16 0.90 0.0 0.0 0.0 0.125 1.56 0.110 0.05 0.059 0.41 
a5 c.0 0.0 0.0 0.0 0.260 36.00 0.250 C.69 0.152 $.17 
22 0.90 0.0 6.0 0.0 0.90 0.0 0.250 25.00 0.063 ~ 6.25 
0 0.633 6.11 0.019 0.04 0.122 0.41 0.203 C.03 C.0S4 0.15 
AVRG 0.0324 0.23 0.0266 0.16 9.1308 2.13 0.1726 0.71 0.09C6 0.81 
CLIN 0.0348 0.12 0.0303 0.09 0.1364 0.16 0.1530 C.18 0.0986 0.18 


PERCENT IMPROVEMENT OP MAP TYEE P-SCORES OVER CLIMATOLOGY P-SCORES 
AT DIPFERENT TIMES BEFCRE ANC AFTER THE CCCURRENCE OF ALL MAPS 


TIAE cIG-a C1IG-B CIG-c c1G-D AYEBAGE 
P-SCORE RLBY(%) P-SCCRE RLBY(%) P=SCORE RLBY(%) P-SCCRE RLEY(%) P-SCCBE BLEY (3) 
%DIPF DIFF SDIFF DIFP ZDIPPF DIPF %DIFF  DIPP SDIPFF DIPP 
-6 -20.54 -0.237 10.£7 0.189 4.36 -1.200 2.57 -0.846 -0.76 -0.525 
-3 =4.14 -0.161 10.08 -0.218 12.91 =-0.490 4.22 -0.988 5.76 -0.968 
c 6.98 -0.110 12.17 -0.065 4.07 -1.974 10.56 -C.533 8.45 -C.670. 
3 -12.96 -0.23%  <-11.15 -0.181 2.06 1.7485 9.42 -1.294 -2.91 -C.863 
6 -20.80 -0.191 -45.56 -0.377 -2.78 =-1.482 Ze11 -6.943 -=16.76 -0.748 
9 9.91 -0.075 5.16 -0.444 10.26 -0.733 Meliss 9.12 -0.658 
42 15.81 -0.056  -12.68 -0.257 9.19 -1.178 3.82 -0.€87 5.03 -0.598 
15 4.41 -0.091 3.24 -G.347 0.20 -1.777 15.44 -1.016 5.07 -0.808 
18 ol) SOAS ApsGrh) oars -3.19 =-1.845 8.23 -1.017 -1.19 ~0.808 
21 12.00 -0.055 -0.21 -0.246 10.68 -0.306 5.86 -1.170 7.08 -0.993 
28 7676 -00174 -16.12 -0.454 6.45 -1.291 6.45. =C.85¢ 4.12 -0.592 


PCE ALL MAPS, THE TCTAL AVERAGE MAP TYPE P-SCORE IS 0.0925 AWD RELIABILITY IS 0.83 PERCENT 
THE TOTAL AVEBAGE CLIBATOLCGY F-SCGRE IS 0.0974 AND RELIABILITY IS 0.17 SERCEME 
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category occurs very infrequently, it results in scores which are low. 

When comparing scores between categories, it is more useful 
to consider the percent improvement of the map-type scores over the 
climatology scores as the measure of the forecast skill of the map- 
type forecast model. For example, the results in Table 6 show the 
map-type model as having greater skill in forecasting category D 
than category A, because the respective percent improvements over 
climatology are 10.6 and 7.0 percent. 

It may also seem incongruous that category A, with the 
fewest occurrences, has a better reliability component than the most 
frequently occurring category D. Table 6 shows that the higher aver- 
age reliabilities in the more frequently occurring categories are 
primarily due to a few very high-percent reliabilities present only 
with certain rather uncommon types - a factor which likely accounts 
for their poor reliability scores. For example, in the presence of 
Type 23, ceiling category C has a class frequency of 0.40, as 
determined from the dependent data. During the independent data 
period, Type 23 appeared 12 times, and each time the ceiling was in 
category C; this means its relative frequency in category C is 1.0. 
The square of the difference between the relative and forecast 
frequency results in a high reliability of 36 percent. The resolution 
component in this example is zero, so the P-Score fs 0.36. The much 
lower number of category-A occurrences reduces the potential for high 
reliabilities, which explains why the average percent reliabilities 
are low. 

Listed at the end of each set of tables is a summarization 


table giving the percent improvement over climatology of the category 
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Eee of the 11 times associated with map types. An example of 
such a table is shown at the bottom of Table 6, a summary of the set 
from which the table above it was extracted. The bottom two lines 
give the overall scores and reliabilities for the set. The signifi- 


cance of these statistics is discussed in the next section. 


6.4 Averaged Verification Results 


Average verification scores were calculated over all four 
categories of ceilings and visibilities, and for all 1] times assoc- 
iated with all map types. The averages were calculated separately 
for forecasts based on 00Z, 12Z and combined O00Z and 12Z map times. 
These results, along with percent improvements over climatology, are 
listed in Table 7. In an attempt to improve the verification scores, 


the forecast model was modified in several ways. The averaged results 
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Ofethe modified versions of the basic model areralso listed in table /. 


The results for the basic model are listed first. The out- 
standing result is that map-type forecasts are a definite improvement 
over climatological forecasts of ceiling and visibility categories. 
There is, however, a significant difference in the forecast skills 
fOmMcenling and Visibility 1onrecasts, «based Onid Wi maprtimes, the 
map-type ceiling forecasts are 5.03 percent better than climatology 
forecasts, whereas visibility forecasts are only 0.80 percent better. 
This discrepancy in forecast skill is understandable in view of the 
fact that the map-type patterns are synoptic features, and categories 
of cloud ceiling are more synoptic in nature than those of visibility. 


The best visibility forecasts are based on 00Z map times, which is 
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Table 7 


Brier verification scores and reliabilities averaged over 
all weather categories, map types and 1] associated times 
(at three-hourly intervals) for map-type-stratified and 

climatology forecasts of independent data from 1969-1972. 


Map Weather Map Type Climat Percent Reliability aie 
Time Element P-Score P-Score Better’ Map Type Climat 
00Z ceilings 0.0908 0.0953 4.72 0.91 0.14 
]2Z (r? = 0.80) 0.0944 020977 Tass 0.88 0.18 
ALL 0.0925 050974) 165.03 0.83 Qui 
00Z Visibil utiess 0.0972 0.0982 1.02 1.55 0.43 
V27 (r = 0.80) 0.1009 OlO17. 20279 1.54 0.58 
ALL 0.0996 0.1004 0.80 142 0.46 
00Z Ceilings 0.0899 020953) 75.07 0.88 0.14 
Pye (ram 0275) 0.0945 050977" E3228 1.03 0.18 
ALL 0.0915 0.0974 6.06 0.80 Ole, 
00Z Visibilities 0.0978 020982) S084] 1.66 0.43 
127 (ra =077'5) 0.1004 OF1017 1428 1.62 0.58 
ALL 0.0988 OF 1004a8 T1859 1.48 0.46 
00Z Ceilings 0.0901 0.0953 5.46 0.86 0.14 
12Z (r = 0.70) 0.0953 On 097 ameeeO 1.05 0.18 
ACG 0.0916 0.0974 5.95 0.81 Only 
00Z Visibilities 0.0976 0.0982 0.61 1.6] 0.43 
eZ (r = 0.70) 0.1006 Op Olas 1.58 0.58 
ALL 0.0994 05 100K0R F100 1.43 0.46 
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Table 7, continued: 


ee en a ee ene eee Pony oe eee eee eee 
Map Weather Map Type Climat Percent Reliability (%) 
Time Element P-Score P-Score Better Map Type Climat 


00Z Ceilings 0.0907 0.0953 4.83 0.90 0.14 
Wz (r = 0.80) 0.0944 0209 jijune2 30 0.88 0.18 
ALL Expanded® 0.0925 0509/4503 0.78 Onis. 
00Z Visibilities 0.0969 O10987 32 sd 0.43 
iz (r = 0.80) 0.1009 0/510) Jemn iO oho 1.54 0.58 
ALL Expanded 0.0985 0.1004 1.89 1.36 0.46 
00Z Ceilings 0.0967 0.0953 -1.47 2} 0.14 
122 (iano 0) 0.0967 0.0977 Wasd2 2.20 0.18 
ALL Gradient? 0.0966 0.0974 0.82 2.04 Only 
00Z Vilsibllipies’ ~—0.1020 0.0982 -3.87 273 0.43 
12Z (r = 0.80) 0.1043 0.1017 -2.56 2.96 0.58 
ALL Gradient 0.1017 0.1004 -1.29 2.49 0.49 


lr - refers to the correlation coefficient used in the map type 
assignment procedure. 


2Expanded - indicates that the dependent map type data base has 
been expanded to include maps that have their second highest 
correlation coefficient greater than or equal to r = 0.8, and 
MieD Wie sO 5 LO. Ges Ni ges temlns 


3Gradient - indicates that all 25 map types have been subdivided 
into three pressure gradient classes. 


4Precipitation forecasts, based on surface map types over Alberta, 
were on the average 6.5 percent better than climatology for 
23-stations (Kocituba, 1974). 


“The average percent reliability for precipitation forecasts for 
23 stations in the Alberta window was 1.08 percent (Kociuba, 


1974). 
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indicative of a local diurnal factor rather than synoptic factor. 

It was mentioned in Section 3.2 that when maps were assigned 
to types using a threshold correlation coefficient of r = 0.75 and 
r = 0.70, there was a successive reduction in the proportion of un- 
correlated maps. These two additional map-type data sets were used 
in the forecast model in place of the basic set of map types which 
had been assigned at r-= 0.80. The averaged verification results from 
this procedure are displayed in Table 7. Only in the case of visi- 
bility forecasts based on 00Z maps, and ceiling forecasts based on 
12Z maps, are the results worse than those of the basic model. The 
forecasts based on all O0Z and 12Z map types of the r = 0.75 data have 
P-Scores better than the other models, for both visibilities and 
ceilings. For the latter, the improvement over climatology is 6.06 
percent, or more than one percent greater than the basic model results, 
but only slightly better than the results of the model using maps 
assigned at r = 0.7. 

The P-Score improvements were not so convincing as to 
warrant an immediate change in the correlation threshold used in 
assigning maps. There is enough evidence, however, to suggest further 
experimentation with other threshold levels using different years of 
independent hourly data at Yellowknife. To determine an optimum 
assignment threshold for the Mackenzie window, similar experiments 
to those just mentioned should be applied to other observing sites 
within the window. 

The dependent hourly data associated with secondary map 
types were incorporated into the calculation of conditional probabili- 


ties. If a particular map was correlated with more than one map type 
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at or above r = 0.80, and the difference between the highest and 
second highest correlation coefficients was within 0.05, then that 
Map was assigned to both types.” In such a’case the’ ll associated 
hourly observations are used to represent the weather related to each 
type. the result of applying enieoeraeeee to the dependent data 
increased the total number of map-type cases from 2467 to 2792. 

The probabilities determined from this ''expanded'' data base 
were used in the forecast model. The resulting verification scores 
for ceiling forecasts, shown on Table 7, are essentially unchanged 
from the scores of the basic model. The percent reliability for 
ceiling forecasts based on all map times, showed a slight drop from 
0.83 to 0.78, but there was no change in the P-Score; this means 
that the resolution components of the forecasts are not as good as 
for the basic model. There ts some improvement in the visibility 
forecasts based on all map times. The average reliability improved 
from 1.42 to 1.36 percent and the forecast skill increased from 0.80 
to 1.89 percent, a significant improvement over climatology. 

It was stated in Section 4.6 that all maps within the 
types were subdivided into three classes of strong, medium and weak 
gradients. The chronological listing of map types in Appendix 2 
indicates the gradient class of each map. These gradient types were 
used in the forecast model. The verification results are the last 
two sets in Table 7. The P-Scores and reliabilities are clearly the 
worst in the Table, with reduced skill shown for ceiling forecasts, 


and negative skill for the visibility forecasts. 


The probability statistics for the gradient types were based 


on the association of hourly weather with 75 types. Tripling the 
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number of types greatly reduces the number of observations associated 
with each type, resulting in a sharp increase in the percent relia- 
bilities. For ceiling forecasts the reliabilities jumped above the 
two percent level, compared to less than one percent for the basic 
model. 

The resolution components of the P-Scores were definitely 
lowered, but not enough to compensate for the poor reliabilities. 
Consider, for example, the ceiling forecasts based on all map times. 
Verification of the basic model forecasts produced an average P-Score 
ofc. 0925. the sum of a reliability component of 0.0083, and a 
resolution component of 0.0842. For the gradient-type forecasts 
the resolution component was lowered to 0.0762, but the reliability 
increased to 0.0204, yielding a worse P-Score of 0.0966. 

The importance of reliable statistics in the development 
of a successful forecast model was aptly demonstrated when using 
pressure gradients for further stratification of the data. Two 
additional conclusions can be derived from the reliability stat- 

WSL CSuInelaple s/s shitst.. the percentarel iabi ities  focivi sibility 
forecasts are consistently worse than those for ceiling forecasts. 
This indicates greater local variability in the occurrences of 
visibility related to map-types. Secondly, the reliability of fore- 
casts based on combined 00Z and 12Z map times is better than the 
reliability based on the individual times. This can be directly 
attributed to the increased number of maps in the combined map-times 
data sample. The improved reliabilities are one reason why the skill 
of ceiling forecasts based on all map times is greater than of fore- 


casts based on the individual map times. From the Table 7 resuits 
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it may be generally stated that better reliabilities and improved 


P-Scores result from enlarging the stratified data bases. 


6.5 Significant Results from the Detailed Verification Scores 


The verification program produced a total of six summary 
tables, identical in format to the one shown with Table 6: one table 
for each of the three groups of visibility and ceiling forecasts based 
on the 00Z, 12Z and combined O00Z and 12Z map times. An analysis of 
all these tables showed no apparent trend in the skill of the fore- 
casts for the 1] times associated with the types. However, for the 
three summary tables of the basic-model ceiling forecasts, the skill 
at map time was always greater than the skill 24 hours after map time. 
The relationship for visibility forecasts was not quite as good. 
Similar comparisons were made between the skill scores for forecast 
pairs at -3 and +21 hours, and at -6 and +18 hours relative to map 
time. For 12 of the 18 pairs in all six tables, the forecast skill 
was greater at the hour nearest to map time. This indicates that 
forecasts near map time are more skillful than forecasts 24 hours 
later. 

A result that stands out clearly on all summary tables of 
the basic model verification is the fact that map-type forecasts show 
less skill than climatology in forecasting weather in the two below- 
VFR categories. For example, the ceiling forecasts of the low cate- 
gories based on all map times were, on the average, 2.5 percent worse 
than climatology forecasts, and the visibility forecasts were | 


percent worse. In contrast to these results, the map-type forecasts 
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of the two highest categories of ceilings and visibilities were 6.1 
and 0.8 percent better than climatology. 

The types that showed the best relationship between low 
ceiling and visibility categories in the dependent data set are given 
in Table 4. For each of these types, the frequency of the associated 
low category weather was significantly greater than the climatic 
Frequency. If this had held true in the independent data sample, 
the P-Scores for these types would have been lower than the climatology 
P-Scores. As it turned out, the frequencies of the low categories for 
a majority of the associated times in the independent data were closer 
to the climatic frequency of the dependent data, resulting in the P- 
Scores for climatology forecasts being better for these types than the 
map-type forecasts. This agrees well with the results given in the 
previous paragraph. 

Map Type 10 was a ''good'' weather type in Te dependent data 
sample, as shown in Table 4, with 92 percent of the associated ceilings 
and 99 percent of the visibilities in the highest weather category. 
This compares with 75.3 and 85.9 percent, respectively, for climat- 
ology. During the independent data period, Type 10 occurred 15 times. 
The P-Score for category-D ceiling forecasts related to this type is 
0.0497, a score averaged over the 1] associated times, and based on 
ferecasts at all map times. This is 73.3 percent better than the 
0.1859 average P-Score for climatology forecasts. The comparable 
visibility forecasts have verification P-Scores of 0.0529 vs. 0.1918 


for a 72.4 percent improvement over climatology forecasts. 
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The forecasts related to the other ''good'' weather types, with 
the notable exception of Type 24, also produce considerably better P- 
Scores than the climatological forecasts. Table 4 shows that during 
eight occurrences of Type 24 in the dependent data sample, 100 percent 
of the ceilings and 95.8 percent of -the visibilities associated with 
the type are in category D. This type appeared only three times in 
the independent sample. During the same six-hour associated-weather 
period, all nine ovservations were in category D, which means that the 
P-Score for this period was a perfect zero. The forecasts at the re- 
maining eight associated times were, however, far from perfect, giving 
an average verification score of only 0.2715. This was -47.6 percent 
worse than the average climatology P-Score for the same period. As 
might be expected, poor reliability was one reason for the high scores. 
The average reliability over the eight hours is 10.5 percent, compared 
Wiitheoniy, 0.59) Tor ei] finamatiorre 

As an individual map type, the uncorrelated group of maps 
exhibits some interesting verification results. The averaged P-Scores 
for the basic model forecasts related to Type U are better than 
climatology for both low weather categories and the highest category. 
The largest improvements over climatology are for the low categories: 
visibility forecasts improved 6.3 percent, and ceiling forecasts 5.8 
percent. 

When the number of maps in Type U were lowered by assigning 
maps at r = 0.7/0, the skill with which Type U forecast category D 
was enhanced, the ability to forecast the two lowest categories was 
reduced, but still slightly better than climatology forecasts. More 


significantly, the P-Scores related to the four types best associated 
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with the low categories improved, and the scores related to the types 
best associated with highest weather category worsened. Since these 

results apply to both ceiling and visibilities, they are significant. 
This suggests that the maps removed from the uncorrelated group when 

the assignment threshold was lowered to r = 0.70 had appreciable 


amounts of below-VFR weather associated with them. 
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CHAPTER VII 


SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 


7.1 The Surface Map-Type Catalogue 


A catalogue of surface map-type patterns over the Mackenzie 
Valley has been developed using the computerized procedures of the 
USAF Map-Typing Project Office In Colorado Springs. The data con- 
sisted of 00Z and 12Z MSL pressures for December, January and February 
at 20 grid points in the Mackenzie window over a 27-year period from 
1946-1972. 

The correlation procedure produced 24 distinct map types. 
The first three appendices constitute the catalogue of types. The 
basic information used to assign maps to types is listed in Appendix 
1]. Jt includes, in Table 8, the MSL pressures at the 20 grid points 
for the key maps representing each type. Also listed in the table 
are the standard deviations of the mean pressure gradient used to 
assign a gradient class to each type. Appendix 2 contains a chrono- 
logical listing of all maps and the assigned types. The gradient class 
of each map is appended to the type designator. The pressure pattern 


of the key map for each type is illustrated in Appendix 3. Statistical 
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information on the pressure and occurrence characteristics is listed 
beneath each key map. 

The key map patterns and the mean pressure statistic clearly 
show the Mackenzie Valley to be dominated by high-pressure systems 
during the three coldest months. This was anticipated in a region 
with a highly continental climate. The eeerer ion on occurrences 
indicates a high degree of map-type persistence which can be related 
to the predominance of the continental Arctic air mass. 

Just over one-third of all maps did not correlate with any 
of the types during the map-type assignment procedure. This high 
percentage of uncorrelated maps reduced the number of maps assigned 
to the correlated types to such an extent that statistical relia- 
bility became a problem when relating hourly weather to individual 
EN NES o 

The wide rence of mean pressure gradients between maps of 
the same type substantiates the conclusions of Scholefield (1973) 
who used simple hypothetical maps to show that the correlation method 
does not discriminate between pressure gradients. Classifying map 
types according to their pressure gradient produced ''sub-types'' with 
similar pressure gradients as well as isobaric configurations. 

The monthly occurrence statistics in Appendix 3 indicate 
slight changes in map-type frequencies that can be related to the 
advance of the winter season. The changes do not appear large 
enough to prevent an expansion of the three-month.cold season. Such 


an expansion is recommended as a means of combatting statistical 


reliability problems. 
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7.2 Yellowknife Weather Related to Map Types 


A few good relationships were found between the annual 
occurrence anomalies of map types and the climatic anomalies of tempera- 
ture and precipitation. There was no evidence of a trend in map-type 
occurrences associated with a pronounced cooling trend that began in 
the late 1940's and continued through the following decade. 

The results of summarizing 16 years of hourly observations 
of aviation weather parameters, present near the time of map type 
occurrences, were encouraging. In all cases, the frequency of weather 
parameters relative to a given type were considerably greater than the 
corresponding climatic frequencies. The four map types that had the 
highest degree of association with a given parameter were noted. The 
best associations were found between map types and the highest cate- 
gories of ceiling and visibility, and the wind direction. The assoc- 
iation between types and precipitation was also fairly good. The 
worst associations were between map types and the lowest ceiling and 
visibility categories. Despite these poor associations, the best 
relative frequencies were still significantly larger than the 
climatic frequencies. 

May Type U was never one of the four best types associated 
with a given weather parameter. This suggests that types which were 
highly associated with parameters should be better than Type U as a 
predictor of that parameter. However, verification results of low 


category ceiling and visibility forecasts showed this not to be the 


case. 
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7.3 Predicting Ceiling and Visibility Categories 


A simple conditional-probability forecast model was developed 
based on the frequencies of ceiling and visibility categories assoc- 
iated with map types during a 16-year dependent data sample. The 
model was tested by calculating P-Scores on probability forecasts 
over four years of independent data. The skill of these map-type 
forecasts was measured by comparing their P-Scores with those calcula- 
ted from forecasts based on pure climatological frequencies. 

The overall results showed map-type forecasts to be better 
than climatological forecasts. Ceilings, being more often of synoptic- 
scale extent than visibilities, were forecast with greater skill than 
visibilities. Ceiling forecasts based on the combined map times of 
Q0Z and 12Z were slightly better than those based on individual 00Z 
or 12Z times only. This was largely due to improved forecast relia- 
bility. Verification results of the model based on gradient-stratified 
map types were the worst of any modei, despite improvements in fore- 
cast resolution. Over-stratification of the data was entirely respon- 
sible for these poor results. 

As this study progressed, it became evident that the statis- 
tical stability of the data was the most important factor affecting 
the verification results. P-Scores worsen in every case where the 
data are stratified too much. Conversely, those stratified weather 
parameters that occur frequently enough to be statistically stable, 
are forecast relatively better than overstratified parameters. This 
factor explains why the map-type-stratified model does not forecast 


the lowest categories as skillfully as climatology. It also explains 
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why the low category forecasts associated with the relatively frequent 
Map Type U are better than those low category forecasts associated 
with more highly associated, but less frequent types. The excellent 
verification results shown by map-type forecasts of the highest 
weather category can be related to the statistical stability of the 
category-D observations. 

An attempt was made to increase the number. of observations 
associated with each type by assigning more than one type to a map 
when the second highest correlation coefficient was close to the first. 
The number of correlation types was also increased by lowering the 
correlation coefficient threshold during the assignment procedure. 

In both cases there was some improvement in the reliability and P- 
Scores of the forecasts. 

These verification results are promising, considering that 
no initial weather condition is incorporated, and the only atmospheric 
predictor is the synoptic weather pattern. There are enough positive 


results to warrant further study. 


7.4. Recommendations for Further Study 


To improve this map-type forecast model to the stage where 
it could be successfully used as an objective aid to aviation fore- 
casting, the following recommendations are made: 

(i) The model should be applied to another location in the 
Mackenzie window and comparisons made with the Yellowknife 


results. 
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(ii) There is no need to alter the correlation coefficient 
threshold (r = 0.8) used in developing the map types, 
but the assignment threshold should be lowered to 
reduce the number of uncorrelated maps and improve 
verification results. 

Citi) Thesdatasbasesshouldabe ence by increasing the 
length of the season, by considering maps at the inter- 
mediate hours of 06Z and 18Z, and by obtaining 
additional hourly data. 

(iv) Forecast reliability could be improved by combining 
the two lowest ceiling and visibility categories; 
also consideration should be given to other signifi- 
cant parameters, such as precipitation and strong 
winds which, essentially, have only two categories: 
occurrence and non-occurrence. 

(vy) The data vshould) be stratifiedvaccesgding to an initial 
weather condition which introduces local effects and 
persistence. This should improve the forecast 
resolution more than the subsequent loss of relia- 
bility. 

(vi) In addition to the P-Score, the ''improved!' model 
should Mego nicicl against persistence and official 
FT's, using contingency table methods. A utility 
score should be included to measure the operational 
effectiveness of the forecasts. 


(vii) Gradient stratification should be considered for 
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select types that occur frequently enough to ensure 
Statistical reliability. 

If the "improved'' model should produce disappointing 
results, consideration should be given to redeveloping 
the map-type catalogue by incorporating derived atmos- 


pheric parameters such as vorticity and thickness. 
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APPENDIX 1 


SURFACE MAP-TYPE WINDOW, GRID-POINT PRESSURE VALUES 


AND STANDARD DEVIATIONS OF THE MEAN PRESSURE GRADIENT 


The surface map type window (dashed lines) is illustrated 
in Figure 2 with the 20 grid points and the locations within the 
window for which terminal forecasts are regularly issued. The dates 
and grid-point pressure values of the key map for each type are 
listed in Table 8. The standard deviations of the mean pressure, 
listed in the table, were calculated from al] the maps assigned to 


each type. The units are in mb/grid interval (381 km). 
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NUMBERED GRID POINTS REFER TO THE ORDER IN WHICH THE 


PRESSURE VALUES ARE LISTED IN TABLE 8 
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APPENDIX 2 


CHRONOLOGICAL LISTING OF THE MAP TYPES ASSIGNED TO 


EACH MAP 


The map types that were assigned to each of the 3814 surface 
maps, using the correlation coefficient threshold of r = 0.8, are 
listed in chronological order. The first eight-digit number in a 
group contains the year, month, day and hour (GMT) of the map. The 
second number is the highest correlation coefficient resulting from 
the correlation between the map and the 24 map types. This is 
followed by the designator of the corresponding type which has 
appended to it a pressure gradient classification, which is either 
strong (S$), medium (M) or weak (W). The second highest correlation 
coefficient follows next, except for uncorrelated maps (Type U) where 
asterisks (*) replace the correlation coefficient. If the second 
highest correlation coefficient is greater than or equal to the 
threshold value, then the designator of the corresponding type is 
listed. If this secondary type is listed, and its corresponding 
correlation coefficient is within 0.05 of the highest correlation 


coefficient, the type is marked with an asterisk (*). 
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APPENDIX 3 


SURFACE MAP TYPES AND CHARACTERISTICS 


At the top of each page is an illustration of the isobaric 
configuration of the key map for a type. The dashed lines form the 
boundaries of the Mackenzie window. One isobar is labelled and the 
isobars are drawn at intervals of four millibars. 

The characteristics of all maps within a type are summarized 
by season and month. The months of January and February in 1946, and 
December, 1972 were not used in the determination of seasonal character- 
istics. The number of times the map pattern occurred during each 
period over the 27 years (1946-1972) is listed along with the per- 
centage frequency relative to each period. This is followed by the 
average of the correlation coefficients resulting from the correlation 
between the key map and all maps assigned to the type. The mean map 
pressures listed have been subtracted from 1000 mb. The pressure 
gradient values are given in units of mb/grid interval (381 km). 

Following the gradient information is a list of the types 
which most frequently foliow the given type and the corresponding 
percentage. Finally, the duration of the map type is indicated by 
the number of 12-hour periods that the type persisted, and the corre- 


sponding percentage. 
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SURFACE MAR TYPE 1 


KEY DATE - 122, 


PERIOD 
OCCURRENCES/FREQUENCY 
MEAN CORRELATION 

MEAN PRESSURE (MSL) 


MEAN PRESSURE GRADIENT 


MEAN MAXIMUM GRADIENT 


MEAN MINIMUM GRADIENT 


MOST FREQUENTLY 
FOLLOWING MAP TYPE 
(MAP TYPE/FREQUENCY) 


MOST FREQUENT DURATION 
(NUMBER OF 12-HOUR 
PERIODS/FREQUENCY) 


SEASON 


343/ 


9 


0.881 


24.42 


25) BeBe 55 


DEC 
94/7 7 
0.879 


24.95 
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JAN 


16177 13 


0.881 
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SURFACE MAP TYPE 2 


KEY DATE - 122, 13 DEC 62 


PERIOD SEASON DEC JAN FEB 
OCCURRENCES/FREQUENCY 253/51 Oy) ee a2 Res 
MEAN CORRELATION 0.891 0.889 0.897 0.887 
MEAN PRESSURE (MSL) 18.30 14.90 19.82 20.68 
MEAN PRESSURE GRADIENT 5.89 5.88 6.37 5.52 
MEAN MAXIMUM GRADIENT 8,71 8.67 9.42 8.21 
MEAN MINIMUM GRADIENT 3.48 3.18 Bou? 3.00 
HOST FREQUENTLY 2/ 42 27 42 2/ 47 2/ 34 
FOLLOWING MAP TYPE U7 Je Us 14 ee ee aes fe 
(MAP TYPE/FREQUENCY) 14f Ga 187 18. Sey 48 U/ 10 
12/7 > 327) 99) 2 ay. 8 6/ 9 
bf, 6 467° 4 6/ 6 i5/ 7 
MOST FREQUENT DURATION 1/ 54 7 58 4/42 1/ 64 
(NUMBER OF 12-HOUR 2/ 30 2/ B25 27-97 2/ 26 
PERIODS/FREQUENCY) B/ 73 4/45 3/ 23 a) ay 
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SURFACE MAP TYPE 


KREQUDALES = 20 


PERIOD 


OCCURRENCES/FREQUENCY 


MEAN 
MEAN 
MEAN 
MEAN 
MEAN 


MOST 


CORRELATION 
PRESSURE (MSL) 
PRESSURE GRADIENT 
MAXIMUM GRADIENT 
MINIMUM GRADIENT 


FREQUENTLY 


FOLLOWING MAP TYPE 


(MAP 


MOST 


TYPE/FREQUENCY) 


FREQUENT DURATION 


(NUMBER OF 12-HOUR 
PERIODS/FREQUENCY) 


SEASON 
1977 5 
0.873 


255.20 


22 DEG 
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SURFACE MAP TYPE 


PERIOD 


OCCURRENCES/ FREQUENCY 


MEAN 


MEAN 


MEAN 


MEAN 


MEAN 


MOST 


CORRELATION 
PRESSURE (MSL) 
PRESSURE GRADIENT 
MAXIMUM GRADIENT 
MINIMUM GRADIENT 


FREQUENTLY. 


FOLLOWING MAP TYPE 


(MAP 


MOST 


TYPE/FREQUENCY) 


FREQUENT DURATION 


(NUMBER OF 12-HOUR 
PERIODS/FREQUENCY) 


PF EE ANS | WADED 2 2A 


SEASON 


1907 


5 


0.874 


24.63 


6.07 


ea ae cd 
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SURFACE MAP TYPE 


KEY! DATE! - 1127),, 22: DEC 59 


PERIOD 
OCCURRENCES/FREQUENCY 
MEAN CORRELATION 

MEAN PRESSURE (MSL) 
MEAN PRESSURE GRADIENT 
MEAN MAXIMUM GRADIENT 
MEAN MINIMUM GRADIENT 
MOST FREQUENTLY 


FOLLOWING MAP TYPE 
(MAP TYPE/FREQUENCY) 


MOST FREQUENT DURATION 
(NUMBER OF 12-HOUR 
PERIODS/FREQUENCY) 


SEASON 

IWS, 5 
0.883 
1533 


Sw 20 


5 


DEC 


83/ 
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0.882 
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SURFACE MAP TYPE 6 


KEY DATE - 122, 


PERIOD 
OCCURRENCES/FREQUENCY 
MEAN CORRELATION 

MEAN PRESSURE (MSL) 
MEAN PRESSURE GRADIENT 
MEAN MAXIMUM GRADIENT 
MEAN MINIMUM GRADIENT 
MOST PREQUENTLY. 


FOLLOWING MAP TYPE 
(MAP TYPE/FREQUENCY) 


MOST FREQUENT DURATION 
(NUMBER OF 12-HOUR 
PERLIODS/FREQUENCY) 


SEASON 


169/ 


5 


0.877 


1D, 22 


16 DEC 


DEC 
69/ 
0.8 


12.4 


62 
JAN 
5 48/ 
80 0.8 
0 15.3 
5 5.2 
7 155 
6 2.4 
53 U/ 
16 a 
8 6/ 
ee ee 
6 2/ 
38 1/ 
29 oy, 
24 
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SURFACE MAP TYPE 7 


KEY, DADEO= W226 2:3) DEC 460 


PERIOD SEASON DEC JAN FEB 
OCCURRENCES /FREQUENCY tite ah 34/7 3 567 A 66/ 6 
MEAN CORRELATION 0.867 0.868 0.867 0.867 
MEAN PRESSURE (MSL) 18.79 16.41 1.97 20.89 
MEAN PRESSURE GRADIENT 4,81 Tey sy 5.00 4.80 
MEAN MAXIMUM GRADIENT Tie 6.97 7.49 Teh 
MEAN MINIMUM GRADIENT Peng. Pssee) 2017 2.28 
MOST FREQUENTLY T/ 33 UY 37 1 Bq T/ 35 
FOLLOWING MAP TYPE HY A8 107 2n Wy AT 10/ 19 
(MAP TYPE/FREQUENCY) 107) AiG ay sin o7 AD U7 aa 
Va 6748 187 18 1/7 12 
6/ 8 WAG 10/7 9 6/ 12 
MOST FREQUENT DURATION 1/7 60 17 22 1/7 53 TY 55 
(NUMBER OF 12-HOUR 2/ 38 2744 Dg 0) 2/ 35 
PERIODS/FREQUENCY) af) 70 37, S BNA LS 
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SURFACE 


PERIOD 


OCCURRENCES/FREQUENCY 


MEAN 


MEAN 


MEAN 


MEAN 


MEAN 


HOST 


CORRELATION 
PRESSURE (MSL) 
PRESSURE GRADIENT 
MAXIMUM GRADIENT 
MINIMUM GRADIENT 


FREQUENTLY 


FOLLOWING MAP TYPE 
(MAP TYPE/FREQUENCY) 


MOST 


FREQUENT DURATION 


(NUMBER OF 12-HOUR 
PERIODS/FREQUENCY) 


SEASON 


2977 
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0.883 


24,05 


4,81 
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DEC 
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APPENDIX 4 


THE BRIER P-SCORE 


The simple forecast model used in this study is based on the 
conditional probabilities of ceiling and visibility categories. Root 
(1962) stresses the importance of resolution and reliability when 
evaluating weather forecasts that contain numerical probability state- 
ments. Forecasts with good resolution have forecast probabilities 
near zero percent or 100 percent. Those with poor resolution have 
probabilities near the climatological frequency. Forecasts with good 
reliability have event forecast probabilities which correspond closely 
with the relative frequency of the respective events. 

In this study, weather events are related to synoptic situa- 
tions. Hence, successive hourly forecasts for a given situation are 
not likely to be independent. Thus, where the number of forecasts in 
a given category is small, a single synoptic situation may account 
for a large percentage of the cases. This introduces a bias in the 
observed frequency of occurrence. A stable observed frequency of 
event occurrence is required to maintain good forecast reliability; 
this can best be accomplished by having a large number of occurrences. 
Reliability is important in this study because increased data strati- 
fication results in fewer cases available for calculating forecast 
conditional probabilities. Hopefully, any loss of reliability due to 


increased stratification can be mcre than compensated for by better 
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resolution. 

A good verification score to use in this study is the Brier 
P-Score (enews 1950) because it measures both the resolution and 
reliability of probability forecasts. The score is calculated from 


the formula 


: 
se Ge eee | (A4-1) 


where on each of N occasions an event can occur in one of r possible 
categories, and in represents the probability that the forecast was 
for a category j occurrence. In this study the r categories for each 


forecast parameter are mutually exclusive and exhaustive, i.e., 


Pi takes the value of one or zero, depending on whether or 
not the event occurred, respectively, in category j. The best score 
for perfect forecasting is a value of zero and the worst value possible 
is two. This score represents essentially the mean of the squares of 
the difference between the forecast and observed probability distribu- 
tions. It is desirable to have a minimum difference; therefore, a 
good score has a small value. 

To isolate the reliability factor in the P-Score formula, 
it is best to consider each individual category forecast separately, 
rather than referring to a set of category forecasts. The Brier Score 


for N forecasts now reduces to 


N 
Doe (free bec (A4-2) 
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and the maximum possible value is one, rather than two. 

The forecast reliability is determined by comparing the fore- 
cast probabilities against the observed percent occurrences of an event. 
To facilitate such a comparison, the forecast probabilities can be 
subdivided into interve!s of 10 percent width, so that all probabilities 


fi, are expressed in tenths. This results in 11 classes 


fe bio: Se Skrorce Thats 


fees 0.0.00.) 2On2 
where f, contains probabilities from 0.0 to 0.04; f, from 0.05 to 0.14 

a GEC. 
Consider a class ''k'' which consists of Mi probability fore- 


casts of a category, and a total of Re event occurrences. The ratio 


of event occurrences to probability forecasts for the kan class is 


For example, if the ceiling category A occurred seven times, and was 


forecast at a probability of 80 percent to occur ten times, then 


Minti) eee 
oe 0 a Vet Ps 


From (A4-2), the contribution to the Brier Score for the 
event occurrences is VAeit, al) ce, and the contribution for non- 
occurrences is 1/M, (Ff, -0)*(M)-R,). The Brier Score for the eet Class 


becomes 


B= (f, - 1)2 + f,2 (1 - 4). (A4-K) 


k 


By adding and subtracting 7 and rearranging terms, (A4-4) can be 
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written as 
a we 2 m, “J 
Bas (fF ) + (] o)) « (A4-5) 


The score for the whole set of N forecasts of a category is 


the weighted average of the scores obtained in the 11 classes 
= 2 os 1 = 
Ue eo) Saree eeu) a iee6) 


In this form the Brier-score formula is separated into its reliability 
and resolution components. 
The reliability term, (fF - $)?, measures the difference 


between the forecast probability f, and the relative frequency of 


k 
occurrence of the event, or. A root-mean-square error (RMSE) in 


reliability can be defined from (A4-6) as 


ll 
RMSE = 108 2 


N 


e i = Singh ; (A4-7) 


l 
with the values expressed as percentages. 

The second term in (A4-6) expresses the resolution of the 
forecasts and depends only on the value of dye It has a minimum 
value when oy is either one or zero. This happens when the event 
always occurs when forecast at 100 percent probability, or when the 
event never occurs when forecast at zero percent. When op an Or5 anche 
resolution term has its maximum value of 0.25. 

In this study Brier Scores are used to verify probability 
forecasts based on pure seasonal climatic frequencies, as wel] as 
those based on climatic frequencies that have been stratified by map 


type and pressure gradient. To compare results, a simple skill score 
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is used that gives the percentage improvement of stratified-climatology 


forecasts over pure climatology forecasts. It is calculated from the 


formula 
Ss = 100 (1) - sB/cB), 


where sB is the Brier Score for stratified forecasts and cB is the 


score for climatology forecasts. 
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